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Purpose  and  Structure  of  Handbook 

In  a real  sense,  planners  are  among  the  principal  architects 
of  the  future.  This  volume  is  designed  to  help  planners  in  the 
Corps  of  Engineers  Civil  Works  Program  improve  their  professional 
expertise  in  long-range  forecasting.  The  study  attempts  to  combine 
the  breadth  of  a text  with  the  specificity  of  a handbook. 

The  report  focuses  on  12  basic  techniques  suitable  for  a wide 
range  of  technological,  economic,  social,  and  environmental  fore- 
casting. These  techniques  were  selected  from  a much  larger  number 
as  being  most  germane  to  the  spectrum  of  forecasting  problems  faced 
by  the  Corps.  In  Section  II  of  this  report  these  12  techniques  are 
compared  along  a variety  of  dimensions.  In  Sections  III,  IV,  and  V 
each  method  is  described  in  terms  of  uBes,  types  of  results,  time 
and  personnel  requirements,  costs,  and  several  other  characteris- 
tics; in  addition,  instructions  are  given  on  procedures  for  apply- 
ing each  method,  along  with  case  illustrations,  many  drawn  from 
Corps  experience.  References  for  further  study  appear  in  Section 
VI,  Appendices  present  supporting  information  and  a glossary  of 
terms;  a detailed  indc  : to  the  report  is  included. 

Why  Forecast? 

It  is  evident  that  the  activities  of  the  Corps  today  impact 
upon  numerous  aspects  of  the  environment  and  society  and  will  for 
generations  to  come.  The  Corps  is  keenly  aware  of  this.  As  a re- 
sult, it  conducts  numerous  surveys  and  investigations  each  year 
designed  to  look  ahead  and  probe  the  potential  future  impacts  of 
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possible  Corps  activities.  Almost  without  exception,  these  studies  > 

j 

require  forecasts  of  various  sorts  as  a basis  on  which  to  determine 
the  optimum  course  of  action  in  view  of  competing  interests  and 
concerns.  Forecasts,  therefore,  are  an  integral  and  critical  com- 
ponent of  the  Corps  planning  process. 

i 

The  explosive  concern  about  the  future  that  has  emerged  in  j 

l 

recent  years  results  from  growing  awareness  of  several  overlapping 

problems:  J 

• Natural  resources  no  longer  can  be  considered  inex- 
haustible. | 

• The  environment  no  longer  is  impervious  to  the  activi- 
ties of  man.  j 

• The  values  of  people  and  institutions  are  at  the  heart  ! 

of  effective  environmental  planning  and  must  be  taken  ; 

into  account. 

« While  economic  growth  is  still  a central  concern,  the  ■ 

emphasis  is  shifting  from  growth  to  equilibrium  and  ' 

from  quantity  to  quality. 

To  plan  effectively  in  terms  of  such  global  issues  as  resources, 

i 

the  environment,  values,  or  quality  of  life  requires  at  least  three 
kinds  of  analyses,  each  of  which  calls  for  a distinct  kind  of  fore- 
casting methodology. 

i 

Problem  Identification  and  Assessment 

Most  problems  encountered  by  the  Corps  today  have  their  roots  ; 

in  past  trends.  Indeed,  it  has  been  said  that  the  most  up-to-date  J 

of  forecasters  deal  with  the  world  as  it  was  10  years  ago.  Future  i 

problems  have  their  roots  in  today's  trends.  The  main  approach  to  ! 


identifying  and  bounding  coming  problems  must  be  through  forecast- 
ing the  emergence  or  evolution  of  present  and  foreseeable  trends 
and  events.  Are  there  or  are  there  not  problems  inherent  in  the 
present  as  it  is  expected  to  unfold  into  the  future?  If  there 
are,  what  are  their  probable  long-term  effects  and  what  kinds  of 
actions  can  be  taken  to  resolve  the  problems?  Problem  assessment 
leads  naturally  to  the  next  major  step  in  planning. 

Consequences  of  Actions 

Here  the  need  is  to  define  the  future  consequences  of  possible 
actions  that  might  be  taken  in  response  to  the  problems  uncovered 
in  the  identification  and  assessment  step.  Our  society  has  become 
so  interconnected  that  it  i a increasingly  necessary  to  try  to  fore- 
see the  consequences  of  an  action  before  taking  that  action.  Not 
too  many  generations  ago  our  society  was  like  a feather  mattress. 
Poke  your  finger  in  one  corner  and  you  would  ruffle  only  a few 
feathers  on  that  spot.  Today,  society  is  more  like  a waterbed. 

Poke  at  ore  corner  and  the  waves  will  travel,  reflect,  and  rever- 
berate throughout  the  whole.  This  characteristic  means  that  no 
proposed  action  can  be  considered  in  isolation.  Physical,  economic, 
social,  and  other  ramifications  all  must  be  examined  and  ther  inter- 
actions identified, 

Normative  (Goal-Oriented)  Judgment 

The  next  step  is  to  anticipate  whether  the  consequences  of 
actions  taken  in  response  to  identified  problems  are  in  accord 
with  the  values  of  the  people  and  institutions  expected  to  be 


affected.  The  problem  here  is  twofold.  First,  one  must  identify 
not  only  primary  impacts  of  an  action,  but  secondary  and  tertiary 
implications  as  well.  These,  often  unanticipated,  side  effects 
frequently  "reach  into  the  home"  in  a way  that  first-level  effects 
do  not.  Second,  a sense  must  be  gained  of  how  people  will  respond 
to  alternative  courses  of  action.  What  do  people  really  want? 

What  are  they  willing  to  give  up  to  solve  a given  problem?  It 
seems  clear  that  some  kind  of  description  of  what  is  considered 
the  desirable  goal  must  precede  the  laying  of  realistic  plans  to 
get  there. 


Clusters  of  Forecasting  Techniques 

To  reflect  the  foregoing  three  basic  aspects  of  long-range 
planning,  the  forecasting  techniques  discussed  in  this  study  have 
been  grouped  into  three  principal  categories: 

• Time  Series  and  Projections,  which  deal  principally 
with  methods  for  trend  forecasting  essential  to  iden- 
tifying and  assessing  current  and  potential  problems. 

• Models  and  Simulations,  which  deal  principally  with 
methods  for  gauging  interactions  among  events  and 
hence  are  essential  for  measuring  the  consequences 
of  actions. 

• Qualitative  and  Holistic  Methods,  which  deal  princi- 
pally with  methods  of  forecasting  the  broad  context 
of  the  future,  including  societal  alternatives  and 
patterns  of  values  on  which  normative  judgments  rest. 


6 


Changing  Inputs  to  Planning 


The  evolution  of  the  foregoing  system  of  planning  is  wr'rth 
examining  from  another  perspective--that  of  changing  input  require- 
ments. The  steadily  widening  range  of  factors  to  consider  in  de- 
vising any  plan  results  largely  from  the  changing  societal  envi- 
ronment in  which  planning  takes  place. 

Traditionally,  most  water  resource  planning  was  based  on 
extrapolations  of  historical  data  to  define  "the"  future.  Usually 
these  extrapolations  showed  an  increasing  demand  for  water  supply, 
flood  protection,  waterway  capacity,  and  so  on,  and  hence  the  need 
for  water  resource  development.  Economic  benefit-cost  analyses 
of  various  courses  of  action  generally  were  applied  to  Belect  the 
economically  optimum  course.  This  system  seemed  to  work  admirably 
for  many  years.  But  here  and  there,  starting  in  the  1960s,  the 
smooth,  established  approach  suddenly  met  highly  vocal  and  orga- 
nized resistance.  There  are  many  planners  in  the  Corps  today  who 
vividly  recall  the  shock  of  discovering  that  the  people  being 
planned  for  had  ideas  totally  different  from  those  of  the  Corps 
about  what  they  wanted  and  needed  for  the  future.  Hence  public 
involvement  has  become  a driving  force  in  planning.  In  varioup 
degrees  this  change  has  also  been  encountered  by  other  public 
agencies. 

It  was  this  recognition  that  led  to  the  swift  development 
and  application  of  "soft"  techniques  able  to  generate  forecasts 
iu  such  areas  as  priorities  and  values.  This  Handbook  discusses 
a sampling  of  such  methods,  a number  of  them  new.  These  methods 
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include  Delphi,  panels,  various  kinds  of  public  surveys,  and 
studies  of  life  ways  and  life  styles.  The  need  to  include  behav- 
ioral components  in  planning  for  the  public  is  well  described  in 
the  following  quote1. 

Behavioral  demand  models,  developed  in  part  because  of 
the  restrictive  nature  of  trend  extrapolation,  and  in 
part  due  to  a malaise  with  traditional  long-range  fore- 
casting in  general,  provide  a freshness  of  perspective. 

In  essence,  we  are  saying  that  the  mechanistic  approach 
to  modeling  and  simulation  for  the  purpose  of  forecast- 
ing must  give  way  to  a better  understanding  of  human 
behavior.  We  must  know  more  about  our  basic  attitudes, 
needs,  and  desires  to  properly  plan  engineered  works. * 

The  discovery  that  people  disagree  vehemently  about  what  is 
desirable  for  the  future  (together  with  the  truth  that  stated  pol- 
icies often  are  not  the  policies  of  fact)  also  points  to  the  need 
for  more  sophisticated  approaches  to  defining  a range  of  possible 
futures.  Otherwise,  no  real  choices  can  be  made.  The  point  is 
a profound  one  because  the  very  concept  of  alternative  futures-- 
rather  than  "the"  future  flowing  from  the  past  without  surprises-- 
suggests  the  need  for  a complete  or  holistic  picture  of  a society. 

One  obviously  cannot  decide  what  kind  of  a future  one  wants  on  the 
basis  of  one  or  a few  variables,  such  as  commun'.ty  water  supply, 
level  of  industrialization,  or  population  density.  To  meet  this 
need  to  choose  among  plausible  futures  seen  holiatically,  a variety 
of  new  forecasting  techniques  have  been  developed  in  the  past  decade. 


Quoted  from  "Predicting  Demand  for  Engineered  Facilities,"  by 
James  P.  Romualdi.  Presented  at  the  July  15-19,  1974,  ASCE/EIC/ 
RTAC  Transportation  Engineering  Meeting,  held  at  Montreal,  Quebec, 
Canada. 
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Those  described  in  this  study  include  scenarios,  authority  fore- 
casting, morphological  analysis  of  society,  and  divergence  mapping. 

Integral  to  describing  total  societies  (alternative  futures) 
and  their  evolution  over  time  (scenarios)  is  societal  modeling  and 
simulation.  Historically,  interactive  or  feedback  models  preceded 
most  holistic  forecasting,  since  modeling  got  its  start  under  gov- 
ernment (chiefly  military)  auspices  to  resolve  a variety  of  plan- 
ning allocation  issues.  The  techniques  developed  for  other  prob- 
lems proved  helpful  for  the  new  issues  faced  by  the  Corps  by  tying 
together  many  of  the  diverse  ramifications  of  a specific  action. 
More  specifically,  the  traditional  benefit-cost  calculations  for, 
say,  flood  control,  needed  to  be  extended  to  include  much  more 
than  flood  control  in  the  new  planning  context.  Recreational, 
wildlife,  environmental,  and  hosts  of  economic  and  community  ef- 
fects also  had  to  be  considered  for  each  action  alternative.  So 
the  need  to  see  the  fine  grain  within  the  broad  future  prospect 
represents  still  another  input  requirement  above  and  beyond  tradi- 
tional Corps  planning.  Forecasting  techniques  pertinent  to  this 
kind  of  analysis  constitute  Section  IV.  A variety  of  methodolo- 
gies are  described. 

In  summary,  roughly  80  percent  of  the  forecasting  techniques 
discussed  in  this  report  deal  with  planning  issues  that  seldom 
showed  up  in  Corps  work--or  in  any  institutional  planning,  for 
that  matter--10  or  15  years  ago.  It  is  this  revolution  in  plan- 
ning that  justified  this  study  and  has  governed  the  selection  of 
the  forecasting  techniques  discussed  here. 
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How  to  Use  This  Handbook 


This  Handbook  has  been  structured  so  as  to  be  serviceable  in 
several  ways.  The  following  tabulation  indicates  some  of  these. 


If  you  want  to: 

See  whether  a specific  item  is 
covered 

Look  up  the  meaning  of  some  term 

Learn  how  the  methods  were 
selected 

Get  a quick  idea  of  how  the 
methods  compare  in  terms  of 
planning  tasks,  subject  areas, 
qualities  of  output,  and  so  on 

See  what  forecasting  techniques 
are  suitable  for  your  problem 

Get  a quick  idea  of  what  a 
forecasting  technique  is 

Understand  or  compare  tech- 
niques in  terms  of  definition, 
assumptions,  history,  main  uses, 
limits  and  cautions,  product 
or  result,  level  of  detail, 
level  of  confidence,  communi- 
cability results,  credibility 
of  results,  span  of  forecast, 
and  resources  required 

Find  out  whether  you  will  need 
help  in  actually  using  the 
technique 

Learn  about  procedures  for 
applying  the  techniques 

Know  more  about  a method  than 
this  Handbook  tells  you  .. 


Start  by  looking  at: 

Subject  index  at  end  of  Handbook 

Glossary  in  Appendix  B 
First  part  of  Section  II 

Comparison  tables  in  the  latter 
part  of  Section  II 


Comparison  tables  in  Section  II; 
full  descriptions  in  Sections 
III  to  V 

"Abstracts"  of  methods  in  Sec- 
tions III  to  V 

Appropriate  subsections  of 
descriptions  in  Sections  III 
to  V 


"Resources"  and  "procedures" 
subsections  of  descriptions  in 
Sections  III  to  V 

"Case  Example"  subsections  of  de 
scrlptlons  in  Sections  III  to  V 

References  cited  in  Section  VI 


Selection  of  Methods  Covered 


Ident Iftcatlon  of  Planning  Areas 

It  was  envisioned  from  the  start  that  this  Handbook  would 
deal  with  10  to  15  forecasting  techniques  of  particular  useful- 
ness to  Corps  planners.  The  initial  problem,  hence,  was  to  chooBe 
these  methods  and  in  so  doing  determine  how  they  might  best  be 
described  and  illustrated.  The  task  was  pursued  in  several  stages. 

The  work  started  by  identifying  significant  broad  areas  of 
planning  concern  for  the  Corps.  These  broad  planning  areas  in- 
cluded the  following: 


Water  quality 
Water  demand 
Population  trends 
Land  use 
Flood  control 
Navigation 
Commodity  flows 


Energy 

Recreation 

Shoreline  protection 
Economic  trends 
Public  participation 
Fish  and  wildlife 
Wastewater  management 


Institutional  change 
Social  change 
Urbanization 
Regional  patterns 
Ecosystems 

Technological  change 
Resource  trends 


The  forecasting  requirements  implicit  in  planning  for  these 
and  other  areas  were  considered  from  several  viewpointa.  Table  1 
shows  one  of  these  classifications,  this  one  organized  in  terms  of 
the  prime  forecasting  needs  of  a field  planner  in  the  Corps. 

In  addition  to  having  to  make  forecasts  in  many  planning 
areas,  the  Corps  has  need  of  forecasts  for  various  periods  into 
the  future.  Moreover,  forecasts  may  be  concerned  with  national, 
regional,  or  local  areas.  Finally,  some  forecasts  strive  to  pre- 
dict what  will  actually  happen  while  others  attempt  to  define 
plausible  alternatives  or  people's  preferences. 
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Table  1 


a ELECTED  AREAS  0E  COUPS  FORECASTING  CONCERN 


1,  Project  Purposes 

Flood  control 

Water  supply 

Navigation 

Recreation 

Hydropower 

Shore  protection 

Wastewater  management 

2.  Basic  Elements 

Hydrology 
Me teorology 
Population  trends 
Economic  trends 
Social  trends 
Technological  trends 
Land  use 
Infrastructure 

,3.  Study  Areas 

a.  Impact  Assessment 

Environmental 

Social 

Economic 

b.  Societal  Valuer./Pre ferencea /Conflict a 

Leisure  time 

GNP  versus  quality  of  life 

Environment  versus  energy  versus  food  production 
Valuation  of  water 

c . Institutional  Considerations 

Water  policies 

Centralization/decentralization  of  government 
controls 

National  policies 


14 


3 

iji 

-I 

Vi 


I 


'i 

f 

I 

! 


This  brief  analysts  revealed  the  extraordinary  diversity  of 
Corps  forecasting  needs,  and  indicated  that  the  selection  of 
methods  to  be  covered  in  the  Handbook  should  start  from  the  broad- 
est possiole  base. 

Initial  List  of  150 

A list  of  150  techniques  mentioned  in  the  forecasting  liter- 
ature was  compiled  and  arrayed  under  six  descriptive  headings: 

(1)  Forecasting  via  surveys 

(2)  Barometric  or  indicator  forecasting 

(3)  Forecasting  via  trends 

(4)  Forecasting  via  models  and  simulations 

(5)  Normative  forecasting 

(6)  Forecasting  via  analogy  and  creativity  techniques 

The  initial  list  of  forecasting  techniques  appears  as  Part  I 
of  Appendix  A.  It  was  fully  recognized  from  the  start  that  this 
list  contained  many  overlaps,  methods  at  different  levels  of  gen- 
erality, and  omitted  many  specialized  variations  of  more  basic 
forecasting  techniques;  further,  the  classification  of  the  methods 
was  subject  to  dispute.  Nevertheless,  the  list  served  the  pur-  • 
pose  of  providing  a useful  "universe"  from  which  to  start  the 
winnowing  process. 

The  73 

The  initial  list  was  easily  trimmed  to  about  100  by  eliminat-  < 

ing  the  more  obvious  and  severe  overlaps.  As  a convenience  in 
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winnowing  further  on  a systematic  basis,  a one-page  form  was 
devised  to  describe  each  method. 

Each  member  of  the  core  project  team  was  given  a batch  of 
the  100  methods  and  asked  to  describe  them,  using  the  form.  This 
work  resulted  in  the  100  collapsing  into  73  one-page  descriptions. 
These  73  are  listed  in  Part  II  of  Appendix  A.  Table  2 shows  a 
sample  method  description  written  up  in  this  form. 

The  31 

The  next  step  in  selecting  the  forecasting  techniques  to  be 
used  in  the  Handbook  consisted  of  rating  the  73  in  terms  of  use- 
fulness to  the  Corps.  In  this  work  the  project  team  was  augmented 
by  consultants  familiar  with  Corps  planning  activities  over  the 
years.  The  result  ot  this  intensive  work  was  a list  of  31  tech- 
niques. As  before,  we  often  found  it  possible  to  fold  into  a 
single  description  several  allied  techniques.  In  the  list  below, 
the  prime  technique  is  listed  first,  followed,  where  appropriate, 
by  the  allied  techniques  (from  the  list  of  73)  that  were  com- 
bined into  the  master  description.  For  each  of  the  31  techniques 
a more  detailed  (5-10  page)  description  was  prepared. 


Pamela  G.  Kruzic,  David  C.  Miller,  Arnold  Mitchell,  and 
Peter  Schwartz. 
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Table  2 


SAMPLE  WRITE-UP 


What  Is  It'? 

Name ; CROSS  IMPACT  ANALYSIS 

De  fin  it  Ion /descrip t Ion:  Comparison  of  Individual  forecasts,  on  a paLrwise 

hosts,  to  determine  whether  there  are  any  interactions',  or  provides  a system- 
atic method  for  examining  the  interactions  among  several  forecasts. 

Historv/degree  of  provenness/promise:  Devised  by  T.  Gordon  and  0.  Helrnuv  in 

the  late  1960s.  Numerous  applications--it  works.  High  degree  of  promise. 

What  Do  You  Get? 

Uses  and  Limitations;  Comparison  of  forecasts  and  testing  policies.  Provides 
greater  clarification  of  issues  and  better  definitions  of  the  risk  and  uncer- 
tainties in  the  subject  being  forecast,  as  well  as  a more  complete  and  consis- 
tent picture  of  some  future  time  period. 

Limitations ; Number  of  forecasts  and  possible  method  inflexibility. 

Form(s)  of  output:  A matrix  of  events  in  rows  and  columns  depicting  the 

Interaction  between  events. 

Level  of  detail!  While  extensive  detail  is  possible  (over  25  events),  the 
procedure  becomes  tedious  and  evaluation  complex. 

Level  of  Confidence;  Judgmental,  but  use  of  experts  and  probabilities  provides 
for  extensive  feedback  and  review. 

Span  of  forecast:  Flexible  (long-  or  short-term)  and  determined  by  nature  of 

events. 

How  Do  You  Do  It? 

Procedures : Very  systematic.  Events  are  suggested  with  probabilities  and 

year  of  occurrence.  Events  are  then  arranged  in  columns  and  rows.  The  inter- 
action between  events  is  shown  in  terms  of  mode  (enhance,  enables, ...  prevents) j 
strength  (10%  ...  1007,)  and  time  lag  (immediate  ...  x years). 

What  Do  You  Need? 

Data  requirements  and  availability:  Forecasts--the  source  of  these  is  often 

Delphi  or  panel  but  can  be  from  any  source. 

People,  Including  organizational  back-up:  Need  "experts"  to  determine  events, 

probability,  and  time  of  occurrence,  AIbo,  rust  evaluate  the  interaction  among 
events. 

Time:  l day  to  1 year,  depending  upon  complexity:  median  1 month. 

Money:  Range:  modest  to  high.  Depends  upon  complexity  of  events,  type  of 

"experts,"  and  whether  a computer  is  utilized. 
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Main  Techniques 


(1)  Trend  extrapolation 


(2)  Social  trend  aialysis 

(3)  Precureor  events 

(4)  Modes  and  mechanisms  of 
change 

(5)  Box-Jenkins 

(6)  Probabilistic  forecasting 

(7)  Subjective  estimates  of 
probability 

(8)  Environmental  systems 
analysis 

(9)  Dynamic  models 

(10)  Cross- impact  analysis 

(11)  KSIM 

(12)  Input/output  analysis 

(13)  Decision  analysis 

(14)  Relevance  trees 

(15)  Normex  forecasting 

(16)  Policy  capture 

(17)  Games 

(18)  Contextual  mapping 

(19)  Risk  analysis 

(20)  Mission  flow  diagrams 


Allied  Techniques  Also  Covered 
in  Description 

Exponential  smoothing,  regres- 
sion analysis,  moving  averages, 
envelope  curves,  link-relative 
prediction,  substitution  fore- 
casting, prediction  of  change- 
over points,  Bayesian  models 

Social  indicators 

Breakthroughs 


Cycle  analysis 


Decision  matrices 
Optimizing  techniques 
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Main  Techniques 

(21)  Scenarios  and  related 
methods 

(22)  Surprise-free  projec- 
tions 

(23)  Morphological  analysis 

(24)  Alternative  futures 

(25)  Divergence  mapping 

(26)  Authority  forecasting 

(27)  Surveys  of  attitudes 

(28)  Panels 

(29)  Delphi 

(30)  Life  ways 

(31)  Synectics 


Allied  Techniques  Also  Covered 
in  Description 


Canonical  trend  variation 


Brainstorming 


Life  style,  psychographics 
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The  Ultimate  12 

To  select  the  ultimate  list,  the  31  techniques  were  rated 
for  their  appropriateness  for  inclusion  in  the  Handbook  In  addi- 
tion to  the  SRI  team  and  its  consultants,  votes  were  obtained  from 
a group  of  Corps  Planning  Associates  and  several  members  of  the 
Chief  of  Engineers  office.  All  were  asked  which  methods  s/he  would 
"surely  include,"  "perhaps  include,"  and  which  s/he  would  "discard." 
Information  was  also  sought  on  which  methods  might  be  combined  into 
one.  A question  concerning  additional  methods  to  consider  produced 
no  suggestions. 


I- 


Voting  on  the  31  methods  is  shown  below  ("perhaps  Include" 


votes  are  not  shown) : 


Forecasting  Method 

Surely 

Include 

Discard 

(1) 

Trend  extrapolation 

10 

0 

(2) 

Social  trend  analysis 

5 

0 

(3) 

Precursor  events 

l 

3 

(A) 

Modes  and  mechanism*  of  change 

4 

3 

(5) 

Box- Jenkins 

2 

1 

(6) 

Probabilistic  forecasting 

5 

2 

(7) 

Subjective  estimates  of  probability 

2 

5 

(8) 

Environmental  systems  analysis 

4 

4 

(9) 

Dynamic  models 

10 

2 

(10) 

Cross-impact  analysis 

5 

2 

(11) 

KSIM 

9 

0 

(12) 

Input/output  analysis 

5 

2 

(13) 

Decision  analysis 

3 

4 

(14) 

Relevance  trees 

4 

5 

(15) 

Normex  forecasting 

4 

2 

(16) 

Policy  capture 

5 

1 

(17) 

Games 

2 

5 

(18) 

Contextual  mapping 

0 

8 

(19) 

Risk  analysis 

5 

1 

(20) 

Mission  flow  diagrams 

1 

6 

(21) 

Scenarios  and  related  methods 

7 

1 

(22) 

Surprise-free  projections 

3 

2 

(23) 

Morphological  analysis 

5 

1 

(24) 

Alternative  futures 

10 

1 

(25) 

Divergence  mapping 

2 

1 

(26) 

Authority  forecasting 

2 

5 

(27) 

Surveys  of  attitudes 

3 

2 

(28) 

Panels 

3 

2 

(29) 

Delphi 

6 

1 

(30) 

Life  ways 

6 

2 

(31) 

Synectics 

0 

6 

It  will  be  noted  that  18  methods  received  four  or  more  "surely 
include"  votes.  It  proved  possible  to  Include  all  except  one  of 


these  (Environmental  Systems  Analysis)  by  combining  several  of  the 
specific  methods  into  a broader  category.  Twelve  baBic  forecasting 
techniques  were  identified  in  this  way,  which  incorporated  some 
25  of  the  31  methods  listed  above.  These  12  were  arrayed  under 
the  three  broad  types  of  forecasting  methods  discussed  in  the  in- 
troduction to  this  Handbook.  These  12  are  liBted  below,  together 
with  the  methods  each  covers  in  the  above  list  of  31.  The  result 
of  these  successive  screening  efforts  is  that  about  50  of  the  ini- 
tial list  of  150  are  covered  in  one  way  or  another  in  the  final  12 
techniques  selected  for  this  Handbook. 


Main  Technique  Others  Covered  from  the  LlBtof  31 

Techniques  Using  Time  Series  and  Projections 

(1)  Trend  extrapolation 

(2)  Pattern  identification  Social  trend  analysis,  precursor 

events,  Box-Jenkins,  Normex 
forecasting. 

(3)  Probabilistic  fore-  Subjective  estimates  of  prob-, 

casting  ability,  risk  analysis,  rele- 

vance treeB. 

Techniques  Baaed  on  Models  and  Simulations 

(4)  Dynamic  models 

(5)  Cross-impact  analysis 

(6) -  KSIM 

(7)  Input/output  analysis 

(8)  Policy  capture 
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Mala  Technique 


Others  Covered  from  the  List  of  31 


Qualitative  and  Holistic  Techniques 


(9) 

Scenarios  and  related 

Surprise-free  projections, 

methods 

authority  forecasting,  modes 
and  mechanisms  of  change. 

(10) 

Expert-opinion  methods 

Panels,  surveys  of  attitudes, 
Delphi. 

(ID 

Alternative  futures 

Morphological  analysis,  diver 
gence  mapping. 

(12) 

Values  forecasting 

Life  ways. 

Nature  of  Descriptions  of  the  Methods 


In  Sections  III,  IV,  and  V,  the  12  forecasting  techniques  are 
described  In  a consistent  format  designed  to  show  the  planner  what 
the  technique  will  do,  and  hence,  how  appropriate  It  la  for  a 
given  forecasting  problem.  Procedures  for  actually  applying  the 
technique  are  presented  by  case  illustrations  following  the  gen* 
eral  description. 

As  indicated  earlier,  some  of  the  techniques  cover  a variety 
of  more  specialized  forecasting  methods  and  some  are  confined  to 
a single  methodology.  For  example,  ’-trend  extrapolation"  covers 

^ to 

some  20  of  the  method?  originally  listed,  whereas  KSIM,  policy 
% * * 

capture,  ^nput-output,  dynamic  models,  and  cross -impact' analysis 
have  stood  alone  from  the  start. 

The  portions  of  the  write-ups  covering  case  examples  required 

t 

that  we  deal  with  a number  ofi  difficult  issues.  W^e  use  the  .word 

"difficult"  because  most  users  will  already  possess  the  knowledge 
1 * 

and  skills  needed  to  make  their  own  applications  of  certain  methods. 
And  most  users  will  find  some  methods  unintelligible,  unusable,  or 
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completely  Inappropriate  to  his  or  her  particular  needs.  The  prob- 
lem is,  of  course,  that  what  falls  in  one  category  for  some  users 
will  fall  in  the  other  category  for  other  users.  An  explanation 
of  procedures  for  a method  that  presumes  little  or  no  knowledge 
will  result  in  a clear  and  helpful  discussion  for  some  users,  while 
covering  the  obvious  to  users  with  a different  background. 

Frankly  acknowledging  the  problem,  we  have  sought  a middle 
way  in  discussing  forecasting  procedures  for  the  various  methods. 

For  each  method  explained,  we  have  called  out  the  basic  steps. 

Thus,  we  have  sought  to  provide  an  outline  of  what  must  be  done 
in  applying  every  method.  We  believe  this  approach  makes  the 
volume  more  useful. 

In  explaining  procedures,  we  have  made  another  basic  decision. 
In  many  cases,  it  would  be  impractical  or  inadvisable  for  a Corps 
user  to  attempt  to  use  a forecasting  method  unassisted  by  a spe- 
cialist experienced  in  that  method.  Dynamic  modeling  or  Box-Jenkins 
forecasts,  for  example,  are  not  acquired  and  effectively  used  merely 
by  reading  a brief  discussion  about  them.  Hence  each  discussion 
includes  comment  on  what  level  of  expertise  is  required  actually 

t:o  forecast  with  the  method. 

* 

In  this  connection,  we  have  not  attempted  to  transform  the 
u^er  into  an  expert  practitioner  of  every  method  cited.  Rather, 
we  seek  to  afford  an  insightful  appreciation  of  what  is  involved 
in  applying  a method.  Hopefully,  this  approach  to  an  explanation 
of  procedures  will"  provide  several  benefits  to  users.  In  the  first 
place,  it  should  assist!  in  making  tentative  and  then  final  selec- 
tions of'  forecasting  approaches  best  suited  to  specific  situations. 


Second,  by  learning  what  Is  actually  involved  in  applying  a given 
method,  the  user  can  anticipate  possible  difficulties  to  be  en- 
countered in  applying  the  method.  Third,  an  explanation  of  pro- 
cedures should  afford  a basis  for  making  approximate  cost  estimates-- 
what  it  will  cost  to  use  a given  method  in  the  project.  (Precise 
cost  guidelines  for  forecasting  activities  are  impossible  to  give 
because  the  scope,  intensity,  and  other  factors  vary  so  widely 
from  case  to  case.)  Fourth,  the  explanation  of  procedures  given 
here  should  help  the  Corps  user  determine  what  sorts  of  special 
skills  are  needed  for  a given  method.  Fifth,  selection  of  tech- 
nical consultants  and  an  intelligent  assessment  of  their  work  as 
it  progresses  should  be  facilitated. 

All  the  examples  used  in  Sections  III,  IV,  and  V concern  or 
relate  to  forecasting  problems  Involved  in  the  planning  of  water 
resources  in  the  Corps  of  Engineers.  The  sole  function  of  each 
example  is  to  illustrate  and  explain  how  a technique  may  be  applied. 
To  that  end,  some  are  based  on  past  Corps  applications,  whether  or 
not  the  technique  was  identified  by  name  in  the  original  research. 
Others  are  hypothetical  but  typ leal  •situations,  which,  for  the  sake 
of  clarity,  are  simplified  and  exclude  most  details  that  would  not 
contribute  to  understanding  the  application.  A few  techniques  are 
extremely  complex,  and  to  use  them  requires  both  a major  effort 
and  highly  specialized  skills.  For  these,  a general  description 
of  the  process  Is  furnished  without  illustration.  It  needs  to  be 
emphasized  that  none  of  these  examples  purports  to  show  in  detail 
how  an  actual  piece  of  research  was,  or  should  be,  carried  out. 
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In  view  of  the  complexity  of  the  forecasting  methods  covered 
in  the  Handbook,  planners  are  encouraged  to  pursue  the  subject  by 
studying  the  literature  recommended  as  "further  readings"  in 
Section  VI. 

Forecasting  and  Planning 

The  distinction  between  forecasting  and  planning  was  a vital 
one  in  designing  this  Handbook.  Forecasts  are  necessary  for  prac- 
tically all  good  planning  but  in  themselves  forecasts  ate  not  plans. 
Intelligent  planning  requires  problem  identification,  the  formula- 
tion of  alternatives,  impact  assessment,  and  evaluation.  In  all 
these  steps,  forecasts  can  serve  as  useful --sometimes  essential -- 
tools  but  they  are  only  part  of  the  processes  of  planning.  This 
Handbook,  therefore,  should  not  be  regarded  as  a planning  manual. 

In  the  winnowing  process  described  earlier,  the  distinction 
between  forecasting  and  the  rest  of  the  planning  process  was  a 
principal  guideline.  Such  techniques  as  systems  analysis,  deci- 
sion analysis,  mission  flow  diagrams,  or  contextual  mapping  were 
discarded  because  they  do  not  produce  forecasts,  although  they  are 
very  useful  in  planning.  Similarly,  techniques  such  as  games  or 
synectics  may  produce  insights  of  great  value  in  planning,  but 
they  are  not  primarily  forecasting  methods. 

The  distinction  between  planning  and  forecasting  is  by  no 
means  always  clear  cut.  Because  of  this,  the  Handbook  has  pur- 
posely included  several  "aids  to  planning"  that, need  not,  in  them- 
selves, produce  forecasts.  Examples  include  survey  techniques 
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(diacussed  in  Expert-Opinion  Methods),  analysis  of  Bocial  indicators 
(discussed  in  Pattern  Identification),  or  cross-impact  methods  (dis- 
cussed in  Cross-Impact  Analysis,  KSIM,  and  Policy  Capture).  These 
"aids  to  planning"  have  been  included  because  they  directly  provide 
grist  for  forecasting  in  much  the  same  fashion  that  time-series 
data  are  essential  to  making  trend  extrapolatlons--that  is,  fore- 
casts. 

The  Handbook  is  concerned  with  forecasting  in  several  senses 

of  the  word.  Some  of  the  methods  chiefly  produce  predictions  (de- 
li 

fined  as  prophecy);  others  are  best  adapted  to  Identifying  possibil- 
ities, whether  or  not  they  are  predicted  or  predictable;  still 
others  are  calculated  to  define  forecasts  in  terms  of  physicals  ^ 
plausibility  or  of  desirability  in  values  terms.  All  these  are 
forecasts  in  the  widest  sense  of  the  term,  and  all  are  useful  in 
various  circumstances  and  hence  have  been  included. 


FOHECASTING  ADJECTIVES 

Forecasting  can  bet 

Short-term,  mid-term,  long-range 

Comprehensive,  far-seeing 

Logical,  deliberate,  rational,  definite 

Intricate,  elaborate,  complicated,  complex,  detailed 

Simple,  clear-cut,  solid 

Daring,  subtle 

Forecasting  can  also  be; 

Makeshift,  tentative 
Grandiose,  unproductive 
Frantic,  weird,  unbelievable 


Sophistication  In  Forecasting 


In  allocating  planning  funds  It  Is  usually  assumed  that  the 
amount  of  effort  should  be  roughly  proportional  to  the  size  or  cost 
of  the  project  being  Investigated  even  though  large  and  small 
projects  generally  contain  the  same  basic  elements.  This  is  a 
good  rule  in  the  sense  that  one  wisely  takeB  greater  care  not  to 
drop  an  ostrich  egg  than  a hummingbird  egg  because  one  makes  so 
much  bigger  a mess  than  the  other.  Hut  in  other  senses  the  rule 
is  far  from  wise. 

There  are  two  main  criteria  in  choosing  forecasting  methods: 

• What  is  the  operational  payoff  of  accuracy  of 
forecasts? 

• How  much  more  accuracy  will  additional  effort 
and/or  sophistication  buy? 

Operational  Payoff 

Consideration  of  the  operational  payoff  of  accuracy  involves 
both  tangibles  and  intangibles.  Where  the  real-life  consequences 
or  error  are  dire,  sophisticated  forecasts  (i.e.,  forecasts  pre- 
sumed to  be  as  accurate  as  possible)  are  Justified,  They  also  may 
be  justified  for  such  less  tangible  reasons  as  public  or  political 
pressure  to  put  on  a "good  show,"  for  their  educational  value  to 
the  planner,  or  even  for  the  sheer  pleaoure  of  doing  the  best 
possible  job. 

If  it  makes  little  operational  difference  whether  the  fore- 
cast is  accurate  or  not,  this  may  be  a sign  that  the  forecast  is 
not  needed  at  all  or  that  the  important  aspect  of  the  subject  has 


been  missed,  Thus  a "forecast"  that  an  earthquake  will  occur  is  op- 
erationally much  less  useful  than  a forecast  of  when  it  will  occur. 

Operational  payoff  is  perhaps  best  considered  in  terms  of  the 
"cost  of  forecasting"  versus  the  "cost  of  inaccuracy."  Although 
each  circumstance  is  different,  some  basic  principles  apply. 
Figure  1 shows  one  way  of  determining  the  optimum  degree  of  fore- 
casting effort  justified  for  a medium-range  forecast,  given  the 
availability  of  reliable  data.  To  enrich  the  diagram,  several 
forecasting  techniques  that  could  be  applied  to  a given  problem 
are  entered  on  the  "cost  of  forecasting"  line.  In  order  for  thiB 
approach  to  be  useful  the  cost  of  forecasting  must  be  an  appreci- 
able fraction  of  the  cost  of  Inaccuracy.  If  forecasting  costs  are, 
say,  only  1 percent  of  the  costs  of  Inaccuracy,  it  1b  evident  that 
almost  any  level  of  effort  to  reduce  inaccuracy  is  justified. 

Accuracy  and  Sophistication 

In  general,  the  more  sophisticated  the  technique  and  the 
broader  the  base  of  factors  considered  the  more  accurate  it  is 
expected  to  he  compared  with  simpler  methods  of  forecasting  the 
same  development.  If  this  is  not  true,  the  simpler  method  is 
always  to  be  preferred, 

Differences  in  accuracy  among  forecasting  techniques  can  be 
very  great.  To  illustrate,  Table  3 shows  errors  in  population 
forecasts  using  various  methods.  In  this  particular  case  the 
cos ts  of  the  methods  are  so  similar  that  one  normally  would  select 
the  one  having  the  least  error. 


Table  3 


ERRORS  IN  POPULATION  FORECASTS 


Average  Error 
In  Percent 


Forecasting  Method 

10 -Year 
Forecast 

20-Year 

Forecast 

Graphical  extrapolation  of  past 
population  growth 

34.9% 

61.8% 

Projections  based  on  exponential 
growth  pattern 

33.0 

51.0 

Projections  based  on  linear 
growth  pat  earn 

14.2 

18.8 

Projections  based  on  ratio  of  area 
to  projected  population  of  region 

9.3 

15.6 

Projections  based  on  S-shaped 
growth  pattern 

8.8 

10.6 

Source:  Baaed  on  Frederick  E.  McJunkin,  "Population  Fore- 

casting by  Sanitary  Engineers,"  Journal  of  the 
Sanitary  Engineering  Division.  ASCE,  Vol.  90, 

No.  SA4,  Proc.  Paper  3993,  August  1964,  pp.  31-58. 


In  the  case  of  time-series  data  directly  representative  of 
the  items  being  forecast,  it  if  usually  possible,  in  a statistical 
sense,  to  prejudge  what  methods  will  yield  the  most  precise  results. 
This  is  no  guarantee  of  accuracy,  howevt  because  it  assumes  that 
the  trends  of  the  past  will  continue  into  the  future.  The  "baby 
booms"  and  "baby  busts"  of  the  postwar  years  show  that  trends  can 
change  radically  in  even  the  most  basic  statistics. 

One  caution  that  cannot  be  repeated  too  often  applies  to  many 
forecasting  methods.  Numerous  techniques,  such  as  risk  analysis, 


optimization,  and  many  models  and  simulations,  deal  with  phenomena 
that  can  be  defined  only  in  terms  of  a series  of  discrete  events 
having  discrete  outcomes.  What  cannot  be  defined  in  such  terms 
must  be  ignored.  Many  complex  phenomena  for  which  we  may  wish  to 
prepare  forecasts  simply  do  not  lend  themselves  to  such  rigorous 
definition.  If  we  insist  on  using  such  methods  in  such  caseB,  the 
results  are  painfully  predictable:  no  matter  how  sophisticated 

the  effort  in  a technical  sense,  we  will  make  unrealistic  defini- 
tions of  a topic,  we  will  ignore  or  underestimate  the  significance 
of  factors  that  cannot  be  handled,  and  we  will  end  up  with  results 
that  appear  exact  and  precise  but  that  may  be  disastrously 
deceptive. 

There  are  other  ereas  in  which  resort  to  sophisticated  tech- 
niques can  be  a waste  of  time  and  effort.  Some  of  these  are 
listed  below.  In  each  case,  the  problem  and  the  available  fore- 
casting tools  must  be  considered  individually. 

• When  the  theory  underlying  the  forecast  is  vague  or, 

in  fact,  nonexistent.  Example:  hunch  forecasts  of 

trends  in  values  or  social  movements. 

• When  reliability  or  pertinence  of  indicator  data  is 

questionable.  Example:  forecasts  of  technological 

breakthroughs  in  a new  discipline. 

• When  the  event  is  largely  judgmental  and  narrowly 

dependent  on  a few  people.  Example:  forecasts  of 

| political  actions  of  foreign  powers. 

,0 

’j  • When  the  forecast  depends  on  so  many  events  so 

[■  complexly  interrelated  that  many  dozens  of  possible 

| outcomes  seem  plausible,  Example:  detailed  fore- 

| casts  of  the  U.S.  transportation  system  in  the  year 


2000. 


Despite  such  problems,  many  of  the  kinds  of  issues  the  Corps 
deals  with  are  forecastable  and  responsive  to  advanced  analytical 
treatment.  Many  of  the  major  exceptions  fall  into  the  domain  of 
forecasting  people's  wishes  and  attitudes,  an  area  that  partakes 
of  many  of  the  characteristics  named  above. 

The  Techniques  Compared 

In  Tables  4 to  9,  we  have  attempted  to  compare  the  methods 
discussed  in  this  Handbook  in  a systematic  fashion.  The  compari- 
sons are  useful  as  a starting  point  in  selecting  methods  for  var- 
ious types  of  forecasting  problems,  but  should  be  used  with  an 
awareness  of  their  limitations.  The  tables  necessarily  reflect 
global  conclusions  that  can  be  disputed  in  specific  Instances. 

For  example,  a given  forecasting  method  can  be  applied  to  problems 
for  which  it  is  not  particularly  well  adapted;  conversely,  the 
particular  context  of  a forecasting  problem  may  be  such  as  to 
invalidate  typical  procedures.  Further,  a method  may  be  good  for 
cursory  treatment  but  less  than  optimum  for  detailed  analysis. 

If  these  klndB  of  limitations  are  borne  in  mind,  the  tabulations, 
which  reflect  "usual  practice"  provide  a start  in  matching  problem 
with  appropriate  technique. 
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I.  ntroduction 


Throe  classes  of  forecasting  techniques  are  discussed  in  this 
section  of  the  Handbook!  trend  extrapolation,  pattern  identifica- 
tion, and  probabilistic  forecasting.  These  methods  are  all  based 
on  series  of  historical  data  that  are  analyzed  in  various  statis- 
tical ways  to  arrive  at  forecasts  of  the  future. 

In  general,  these  techniques  are  the  most  commonly  used,  the 
most  easily  used,  and  the  most  understandable  of  all  forecasting 
methods.  Even  so,  some  require  advanced  mathematical  skills  and 
utilize  subtle  concepts.  The  methods  are  remarkably  flexible  in 
the  kind  of  problem  they  can  treat  and  the  level  of  detail  of  re- 
sults, The  methods  are  often  used  by  themselves  to  generate  fore- 
casts on  specific  subjects;  they  also  are  extensively  used  to  gen- 
erate inputs  to  many  forecasts  based  on  models,  and  to  help  quantify 

• >> 

trends  utilized  in  more  qualitative,  holistic  types  of  forecasting. 
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TREND  EXTRAPOLATION 


General  Description 

Abstract 

Trend  extrapolation  is  the  general  name  for  a variety  of 
mathematical  forecasting  methods  all  of  which  determine  future 
values  for  a single  variable  through  some  process  of  identifying 
a relationship  valid  for  the  past  values  of  the  variables  and  a 
solution  for  future  values.  Although  the  technique  is  generally 
useful  for  only  a single  variable,  this  variable  may  be  highly 
complex  in  that  it  may  reflect  numerous  trends.  It  should  be 
recognized  that  since  only  quantifiable  variables  may  be  forecast 
through  extrapolation,  a bias  is  introduced  against  that  which  is 
nonquant ifiabl a.  A major  limitation  of  extrapolatory  methods  is 
that  they  are  not  able  to  deal  with  unanticipated  changes  in  the 
historical  pattern  of  the  data.  Trend  extrapolation  includes  such 
methods  as  "eye-balling,"  moving  averages,  exponential  smoothing, 
substitution  and  growth  curves,  envelope  curves,  and  simple  and 
multiple  regression. 


Definition 

Trend  extrapolation  is  a family  of  quantitative  forecasting 
techniques  all  of  which  depend  on  extending,  or  extrapolating, 
time-series  data  in  accord  with  specified,  usually  mathematical, 
rules.  The  extrapolations  constitute  the  forecast. 
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The  specific  methods  used  to  extrapolate  include  a variety 
of  growth  curves  (such  as  Pearl  and  Gompertz  curves),  straightline 
extrapolation  curves,  cycles  of  various  sorts,  regressions,  moving 
averages,  link-relative  predictions,  exponential  smoothing,  and 
many  others.  Easily  the  most-used  method  of  extending  time-series 
data  is  "eye-balling," 

The  data  used  are  usually  actual  counts  of  the  phenomenon 
under  investigation,  such  as  population,  flow  rates,  events  per 
units  of  time,  or  dollars  earned.  The  methods  also  can  be  used 
with  proxy  data  or  other  kinds  of  indicators,  provided  they  are 
available  for  a long  enough  period  to  reveal  a pattern  of  develop- 
ment that  can  be  used  as  a basis  for  extrapolation. 

Trend  extrapolation  depends  on  the  hypothesis  that  past  and 
present  trends  will,  in  the  future,  develop  in  the  same  direction 
and  at  the  same  rate  as  in  the  past,  unless  there  is  a clear  indi- 
cation of  a shift  in  trends.  Such  shifts--not  always  foreseen-- 
account  for  some  recent  spectacular  errors  in  extrapolatory  fore- 
casts. Population,  inflation,  and  oil  prices  are  recent  examples, 
along  with  that  perennial  favorite,  the  Dow  Jones  average. 

Assumptions 

In  using  methods  based  on  trend  extrapolation  it  is  assumed 

that: 

• The  important  variables  in  a persistent  phenomenon 
can  be  identified. 


43 


• Sets  of  data  can  be  assembled  that  describe  the 
interrelationships  among  the  important  variables-- 
at  any  one  point  in  time,  and  also  over  a series 
of  successive  intervals  of  time, 

• Data  representing  each  point  in’.time  are--or  can  be 
converted  to  be--directly  comparable  with  data  rep- 
resenting other  points  in  time  for  the  same  variables. 

• Underlying  causal  factors  are  responsible  for  varia- 
tions in  data  values,  so  that  persistent  patterns  in 
the  directions  or  rates  of  data  variations  provide 
the  basis  for  significant  cause-effect  explanations. 

• The  direction  and  rate  of  data  variations  in  preceding 

time  intervals  is  likely  to  persist  in  successive  time 
intervals.  , ! 

More  recently,  and  by  no  means  universally,  trend  extrapola- 
tions sometimes  recognize  that  the  structure  and  dynamics  of  a 
phenomenon--e.g. , population  density  in  a given  locality--often 
impose  predictable  limits  on  directions  and  rateH  of  trend  devel- 
opments. When  these  limits  are  known,  their  implications  are  use- 
ful in  predicting  future  directions  and  rates  of  trend  development. 


History  ’ 

The  instinctive  use  of  trend  extrapolation  goes  back  to  the 
dawn  of  man.  Surely,  even  the  most  primitive  man  was  confident 
that  day  would  follow  night  simply  because  "time-series  analysis" 
showed  no  exceptions.  In  a more  sophisticated  fashion  the  ancient 
Greeks  developed  theories  of  cosmology  by  noting  changes  in  posi- 
tions of  stars  over  many  years. 


Trend  analysis  and  projection  has  in  recent  decades  enjoyed 


an  expansion  that  amounts  to  a boom,  Among  the  causal  factors 
explaining  this  rising  interest  are: 

• The  growing  complexity  and  interdependence  of  civil- 
ization. Trends  in  one  sector  are  apt  to  cause  im- 
portant effects  immediately  or  in  the  future  in  many 
other  sectors.  The  human  environment  is  increasingly 
human-made,  abstract,  and  subject  to  rapid  shifts  in- 
sulting from  human  decisions  and  actions.  Trend  anal- 
ysis and  forecasting  has  become  an  indispensable  tool 
for  understanding  what  is  happening  to  us. 

• As  society  &rows  more  complex,  more  ar.u  more  transac- 
tions are  formalized  and  recorded.  One  result  of  this 
is  more  and  more--and  in  some  cases  more  and  more  ac> 
curate--time-series  data.  Thus,  opportunities  for 
trend  projections  based  on  existing  data  are  more  and 
more  widely  and  readily  available. 

• The  "computer  revolution"  has  encouraged  the  develop- 
ment and  use  of  diverse,  sophisticated,  and  often 
powerful  methods  that  enable  us  to  analyze  and  project 
trends  rapidly  and  at  relatively  low  costs. 

For  such  fundamental  reasons  as  these,  much--perhaps  even 
mo8t-«contemporary  research  in  economics,  political  science,  and 
the  other  behavioral  and  social  sciences  is  centrally  dependent 
upon  or  makes  heavy  use  of  trend  analysis  and  projection  methods. 


Main  Uses 

Trend  extrapolation  is  not  only  one  of  the  oldest  but  also 
one  of  the  most  widely  used  futures  forecasting  methods.  So  wide- 
spread and  common  are  such  methods  that  it  is  quite  impossible  to 
identify  "main  uses."  It  Is,  however,  v.'ideiy  used  in  the  physical 


biological,  behavioral,  and  social  sciences;  in  the  management  of 
organizations  and  institutions;  in  every  realm  of  technology;  and 
in  marketing  and  finance*  The  Corps  has  used  it  in  3coree  of  area:, 
such  as  population  estimates,  water  demand,  recreation  projections, 
flood  damage  probabilities,  and  so  on.  Indeed,  one  is  hard-preBsed 
to  identify  a field  o?  human  enterprisa  in  which  trend  extrapola- 
tion is  not  a s.;«.\if leant  tool. 

Limits  and  Cautions 

The  limits  of  trend  extrapolation  methods  are  simply  stated 
but  observed  only  with  major  effort  and  difficulty.  They  are  the 
limits  of  the  data  base,  of  reliability,  and  of  validity. 

Data  base  limitations  refer  to  the  fact  that  information  on 
many  key  variables  has  been  recorded  for  periods  too  brief  to  per- 
mit clear  analysis  of  trends.  Worse,  data  for  different  periods 
may  not  in  fact  be  parallel  although  they  may  be  presented  as  such. 
Definitions  and  standards  of  data  acquisition  and  recording  vary 
greatly  from  time  to  time,  place  to  place,  and  situation  to  situ- 
ation: accordingly,  the  challenge  of  comparability  of  data  is 

often  severe. 

The  reliabilicy  of  trend  extrapolation  also  involves  the 
issue  of  technical  competency.  A forced-fitting  of  data  points 
to  a preconceived  curve  may  conceal  more  than  it  reveals.  Insuf- 
ficient tests  of  statistical  significance  may  suggest  important 
correlations  where  none  actually  exists  or  obscure  the  fundamental 
relationships  sought. 
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The  validity  problem  goes  beyond  those  of  data  reliability 
and  technical  competence.  Even  when  data  are  accurate  and  stan- 
dardized, and  when  the  extrapolation  method  has  been  used  with 
great  competence,  fundamental  issues  remain  unresolved.  Consider, 
for  instance,  measures  of  environmental  quality.  There  is  not  as 
yet--in  fact,  may  never  be--general  agreement  as  to  which  variables 
best  measure  environmental  quality.  Ouch  being  the  case,  different 
observers  will  accept  or  reject  different  subsets  among  the  candi- 
date variables.  Which  particular  subset  of  variables  is  the  most 
accurate  and  adequate  measure  of  environmental  quality?  Ko  one 
can  say-~or  rather,  any  one  can  say,  but  no  one  can  offer  satis- 
factory proof  that  his  or  her  view  is  most  nearly  correct. 


'I 


Other  Techniques 

As  mentioned  above,  trend  extrapolations  are  used  by  nearly 
everyone  for  nearly  everything.  Virtually  ovary  other  method  dis- 
cussed in  this  Handbook--and  many  not  mentioned  as  well--can  be 
used  as  well  as  or  better  than  the  trend  extrapolation  method  in 
some  application.  Few  if  any  methods,  on  the  other  hand,  can  be  | 

or  are  used  in  as  many  different  applications  as  are  trend  extrap-  j 

olation  methods.  j 

i 

Product  or  Result 

Simple  or  elaborate,  the  end-result  of  a trend  extrapolation 
study  consists  of  a set  of  data  points  with  associated  measures 
of  their  interrelationships.  These  relationships  can  be  shown  j 

j; 

among  data  points  for  a single  time  period,  and/or  among  data  j 
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points  for  two  ot  more  time  periods.  In  physical  form,  the  product 
may  be  a series  of  tabulations,  a series  of  graphic  displays  show- 
ing trend  curves,  or  something  as  elaborate  as  an  interactive  com- 
puter model  in  which  Implicit  relationships  may  be  called  up  and 
explored  at  will. 

Level  of  Detail 

Typically,  results  are  fine  grained,  reflecting  the  nature 
of  most  time-series  data.  Grosser  results  will  come  from  extrap- 
olation of  grosser  data,  such  as  poll  data  on  overall  satisfaction 
with  housing. 

Level  of  Confidence 

Confidence  in  the  result  of  a trend  extrapolation  study  is 
largely  gauged  by  two  factors:  the  extent  and  quality  of  the  data 

base  used,  and  the  perceived  validity  of  the  underlying  explanatory 
model,  Consider,  for  example,  two  hypothetical  studies,  one  deal- 
ing with  U.S,  population  growth  trends  since  1790  and  the  other 
treating  political  radicalism  in  the  United  States  during  the  past 
decade.  Presuming  Identical  standards  of  professional  competence 
and  dispassionate  interest  in  the  two  topics,  the  population  study 
must  intrinsically  inspire  greater  confidence.  The  population 
study  enjoys  an  unbroken  set  of  time-series  data  for  a period  of 
nearly  two  centuries,  while  the  radicalism  study,  by  definition, 
la  limited  to  10  years.  The  topic  of  the  population  study  is 
clear--how  many  citizens  ware  alive  and  counted  at  given  times-- 
while  the  topic  of  the  radicalism  study  is  obscure  and  controversial, 
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The  population  study  uses  simple,  directly  applicable  data  while 
the  radicallom  study  must  necessarily  rely  on  such  proxy  data  as 
can  be  scraped  together.  For  such  fundamental  reasons,  the  extent 
and  quality  of  data  used  in  a trend  extrapolation,  together  with 
the  demonstrable  validity  of  a study's  assumptions,  greatly  influ- 
ence the  level  of  confidence  such  studies  enjoy. 

Communicability  of  Results 

< 

Because  trend  extrapolation  methods  are  universally  used, 
the  essence  of  the  method  and  the  direct  import  of  the  findings 
are  readily  conveyed,  even  to  persons  with  no  special  training  in 
such  methods.  The  proofs  and  assumptions  on  which  the  findings 
are  bfised  are  another  matter.  Here  at  once  arise  all  the  issues 
mentioned  above  under  "Limits  and  Cautions."  Aporeclatlon  of 
statistical  and  other  (often  complex)  analytic  methods  may  also 
be  difficult  or  impossible  to  convey.  L 

Credibility  of  Results 

The  credibility  of  a trend  extrapolation  study  depends  almoBt 
wholly  on  the  specific  situation.  Fc r example,  many  people  will 
accept  the  general  shape,  direction,  or  slope  of  a trend  curve 
without  understanding  or  questioning  underlying  assumptions.  In 
that  sense,  a trend  extrapolation  ctudy  may  well  enjoy  more  credi- 
bility than  it  deserves.  People  also  may  be  either  totally  un- 
critical or,  in  other  cases,  relentlessly  critical  of  the  data 
base  for  a given  study.  Finally,  there  is  nearly  always  at  least 
some  controversy  about  the  significance  of  a given  trend  with 
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respect  to  a given  topic.  For  example,  people  who  agree  that  the 
U,S.  birth  rate  is  now  dropping  often  disagree  sharply  about  the 
implications  of  current  trends  for  the  future  demographic  struc- 
ture of  the  United  States. 


Span  of  Forecasts 

Because  trend  extrapolations  are  so  widely  and  diversely  used, 


their  time  spans  vary  enormously  from  application  to  application. 
The  U.S.  Census  Bureau,  for  example,  regularly  projects  population 
trends  for  50-year  periods.  By  contrast,  few  econometricians  care 
to  project  economic  trends  further  than  five  years  in  advance. 


The  nature  of  the  topic  under  study  also  helps  determine 
appropriate  time  spans.  Long-term  demographic  trends,  for  exam- 
ple, may  develop  over  many  years  before  they  are  detected.  Trends 
in,  say,  securities  markets,  by  contrast  may  develop  dramatically 
over  a few  days  or  weeks  because  securities  trading  is  a fast- 
moving,  volatile  enterprise. 


Resources  Needed 


All  extrapolatory  methods  require  the  availability  of  reliable 
historical  data.  Beyond  that,  resources  range  from  a French  curve, 
a slide  rule,  and  a few  minutes  for  the  simpler  methods,  to  ad- 
vanced statistical  skills,  a computer,  and  elaborate  programs  for 
complex  methods.  Generalities  do  not  apply  concerning  time  and 
cost  requirements.  "Eye-balling"  of  some  trends  can  be  done  in 
seconds  at  essentially  no  cost.  At  the  other  extreme,  mathematical 
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analysis  of  complex  data  series  and  computer  programming  to  derive 
extrapolations  can  require  weeks  or  months  of  time  arid  many  thou- 
sands of  dollars.  Very  rarely  do  trend  extrapolations  of  single 
variables  cost  over  $10,000. 

Procedures 

In  general,  trend  extrapolation  is  easy  to  do.  Once  appropri- 
ate Lime-series  data  are  plotted,  the  rhythm  of  the  curve  ia  often 
self-evident.  In  some  cases,  all  that  is  required  to  extrapolate 
is  a ruler  or  a French  curve.  For  more  complex  situations,  plan- 
ners unfamiliar  with  statistical  mathematics  will  need  help.  Very 
often  this  help  is  readily  available  in  the  form  of  computer  pro- 
grams for  curve  fitting. 

Case  Example 

Trend  Extrapolation  Via  Curve  Fitting 

The  mathematical  assumption  underlying  trend  extrapolation 
is  that  a relatively  orderly  progression  of  historical  data  will 
continue  into  the  future.  The  basic  procedure  for  forecasting 
(once  the  historical  data  have  been  selected)  involves  determin- 
ing the  appropriate  form  of  the  curve,  and  extrapolating  the  future 
values  using  the  appropriate  curve  equation. 

Curve  Fitting 

If  a computer  curve-fitting  program  is  available,  one 
can  use  the  computer  to  determine  the  appropriate  form  of  the  curve 


For  example,  the  CURVE*  analysis  performs  a least  squares  fit  for 
six  types  of  curves.  The  six  curve  types  are  shown  below,  where 
y is  the  dependent  variable, 

y * A + B x y = A + (B/x) 

y * A(xB)  y = 1/ [A  + (Bx)] 

Do 

y = A(e  ) y = x/[A  + (Bx)]  . 

To  perform  curve  fitting,  the  user  types  in  the  values 
for  the  Independent  and  dependent  variables.  The  computer  then 
prints  a table  containing  the  general  curve  equation,  the  calcu- 
lated  values  of  A and  B,  and  the  index  of  determination  for  each 
curve,  The  closer  the  value  of  the  index  of  determination  is  to 
1,  the  better  the  fit  to  the  respective  curve  equation.  In  Table 
10  it  is  evident  that  curve  type  1 gives  the  best  fit.  The  calcu- 
lations are  performed  by  appropriate  transformations  of  the  vari- 
ables, A simple  linear  regression  is  then  used  to  calculate  A and 
B.  A sample  computer  output  is  shown  in  TAble  10. 

If  a computer  program  is  not  available,  the  fit  muBt  be 
done  by  hand.  First  the  data  must  be  plotted  on  graph  paper  to 
see  the  form  of  the  curve.  If  the  plot  shows  a nonlinear  form, 
historical  data  must  be  transformed  to  fit  the  basic  linear  least 
squares  form. ^ Then  a least  squares  fit  must  be  performed  to 


CURVE  is  available  from  Tymshare  Incorporated  as  part  of  their 
statistical  package  (STATPAK) . 

The  least  squares  fit  uses  the  following  basic  linear  equation: 
y = A + Bx. 
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SAMPLE  COMPUTER  CURVE  FIT  OUTPUT 


Least  Squares  Curves  Fit 
Index  of 

Determination  A 


Curve  Type 

1.  Y«A+(B*X) 

2.  Y*A*EXP(3*X) 

3.  Y-A(XtB) 

4.  Y»A-i  (B/X) 

5.  Y*l/<A+a*X) 

6.  ,Y«tX/(A+B*X) 


0, 59624586E-01 
0 . 93679343E -01 
0.52892795E-02 
0, 37433361E -01 
0.13587205 
0. 41107133E-02 


5.9440559 

6.0601784 

4.9421407 

5.518248 

0.15059108 

0.27737894E-01 


B 


-0.25174825 
-0.70761195E-01 
-0, 51773591E  -01 
-1.4262832 
0.2230Z697E-01 
0.324 14747 


Details  for  2: 


Yn,A*EXP(D*X) 

is 

an  exponential  function. 

The  results 

a least-squares 

fit  of  its  linear 

transform  are  as 

follows : 

X-Actual  Y 

-Actual  Y-Calc 

Percent 

Difference 

1.0 

3 

3. 6461734 

-46.81 

;/ 

1.5 

4 

5.449901 

-26.6 

2.0 

5 

5.2604514 

-4.9 

2,5 

6 

5.0775875 

10.1% 

3.0 

7 

4.9010803 

42.8 

3.5 

8 

4.7307089 

69.1 

4.0 

7 

4. 5662599 

53,  2 

4.5 

6 

4,4075274 

36. 1 

5.0 

5 

4.2343129 

17.5 

5.5 

4 

4.1064244 

-2,5 

6.0 

3 

3.9636768 

-24.3 

6.5 

2 

3.8258913 

-47.7 
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determine  the  values  of  the  parameters  A and  B, * Finally,  future 
values  of  y can  be  extrapolated  or  calculated  using  the  equation 
just  determined. 

Trend  Extrapolation 

Although  several  different  forms  of  growth  curves  qre 
available  for  forecasting,  the  S-curves  are  most  commonly  used. ^ 
Figure  2 illustrates  two  such  growth  curves,  the  Pearl  curve,  and 
the  Gompertz  curve.  The  Pearl  curve  is  used  in  this  example  to 
illustrate  the  trend  extrapolation  forecast. 

Consider,  as  an  example  of  this  approach,  the  problem 
of  a community  that  has  decided  to  limit  its  population  growth  to 
some  fixed  level--say  700,000.  We  wish  to  foreoart  the  community 
population  growth  from  1970  to  the  year  2000  if  the  total  is  to 
remain  below  the  limit.  First,  the  historical  data  for  the  popu- 
lation of  the  community  are  plotted  on  semilog  paper  Sb  shown  in 
Figure  3.  Determining  from  the  plot  that  the  curve  form  is  the 
Pearl  curve,  the  historical  data  are  transformed  to  allow  for 
curve  fitting  by  the  least  squares  method.  The  historical  data 
and  transformed  values  are  shown  in  Table  11. 

iV 

Use  tim  following  equations  to  calculate  A and  B for  the  least 
square  fit  (r  equals  the  number  of  xy  pairs). 

A = [(Ey  E*2)  - (Ex  Exy)]/[nEx2  - (Ex)2] 

B =>  [tiExy  - (Ex  Ey)]/[nEx2  - ( 23 x) 2 ] 

+ 

"It  is  generally  believed  that  technical  time-series  data  in 
arithmetic  scales  produce  S-curves,  reflecting  a slow  start, 
exponential  growth,  then  a leveling  off  against  some  limit  pro- 
duced by  nature  or  man"  (Bright,  1972). 
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PEARL  CURVE 


QOMPERTZ  CURVE 


Tha  aquation  for  tha  Pnrl  Curva  It: 


1 +7rR 


V * population,  unknown  for  tha  preiant  to  tha  yaar  2000 
L - uppar  limit  to  growth,  700,000 
a * paramatar,  datarmlna  from  hlitnrleal  data 
b « paramatar,  datarmlna  from  hlitorloal  data 
t ■ tlma, 


For  aaia  of  manipulation,  wa  flrit  raarranga  Equation  (1)  and  taka  tha  loga  ai  ihown  balow: 


tin  ^ « l\  ' Ina  ■ bt 
w lat  V - tin  - 1^ 


If  wa  now  lat  V ■ tin  ^ - \j  wa  can  uia  tha  fallowing  axpraulon  for  tha  laait  tquarai  fit: 
Y*  - Sna  - bt 


FIGURE  2 S-CURVES  WITH  A DESCRIPTION  OF  THE  PEARL  CURVE 
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Pearl  Curv*  (Calculated  Value) 
Population  Porecait 


ASSUMED 

LIMIT 


Table  11 


COMMUNITY  POPULATION -- 
ACTUAL  AND  TRANSFORMED  DATA 


Year 

Actual 

Transformed'v 

1876 

1,000 

8.85 

1880 

1,100 

6.45 

1385 

2,700 

5.55 

1890 

3,600 

5.26 

1895 

4,800 

4.97 

1900 

17,600 

3.66 

1905 

48,800 

2.59 

1910 

82,000 

2.02 

1915 

103,900 

1.75 

1920 

123,400 

1.54 

1925 

144,600 

1.34 

1930 

162,600 

1.19 

1935 

136,400 

1.19 

1940 

165,100 

1.17 

1945 

198,100 

0.93 

1950 

280,800 

0.40 

1955 

337,200 

0.07 

1960 

407,800 

-0.34 

1965 

478,200 

-0.77 

1966 

498,700 

-0.91 

1967 

518,300 

-1.05 

it 

Assuming  an  upper  population  limit  (L) 
of  700,000  people  we  use  the  following 
expression  to  transform  the  data, 

Y'  - - l)  . 

Thus,  in  1967  the  transformed  value  is 
calculated  as  follows: 


Y'  = 


!n 


/ 700,000 
\ 518,300 


‘) 


-1.05 
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The  transformed  data  are  used  to  calculate  the  A and  B 

parameters  for  the  Pearl  curve  based  on  the  least  squares  method 
» 

presented  previously.  Now  the  historical  trend  can  be  extrapolated 
by  using  Equation  4 in  Figure  2 to  forecast  the  population  between 
1970  and  2000.  Since  we  have  used  and  forecasted  the  transformed 
values,  it  is  necessary  to  invert  or  change  the  transformed  values 
to  actual  population  numbers.  Table  12  shows  the  calculated  as 
well  as  the  inverted  values  in  numbers  of  people.  The  forecasted 
population  values  for  1970  to  the  year  2000  are  also  shown  in  Fig- 
ure 3. 

The  Pearl  curve  shows  that  an  annual  growth  rate  between 

1970  and  2000  of  less  than  1 percent  is  permissible  ii  the  popula- 
tion is  to  be  held  to  700,000  people  in  the  year  2000. 


Trend  Extrapolation  for  Small  Areas  Using  Proxy  Data 

Many  water  resources  projects  must  be  planned  and  implemented 
in  small  geographic  areas,  or  in  thinly  populated  rural  regions. 

In  such  situations,  forecasting  prospects  of  future  growth  in  the 
area  can  be  extremely  difficult.  Existing  data  bases  are  likely 
not  to  be  sufficiently  disaggregable,  or  to  use  awkward  boundaries. 
Since  appropriate  time-series  data  are  not  available,  it  is  not 
feasible  to  use  direct  trend  extrapolation  techniques. 

The  problem  is  regularly  encountered  in  market  research,  and 
in  survey  research  throughout  the  behavioral  and  social  sciences, 
as  well  ns  in  water  resources  planning.  The  Bureau  of  the  Census 
is  keenly  aware  of  the  problem,  and  makes  everv  effort  to  assist. 
For  example,  the  Bureau's  Small  Area  Data  Notes  1b  widely  consulted 
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CALCULATED  VALUES  FOR  COMMUNITY  POPULATION 
1876-2000 


Calculated  Valuer.* 


Year 

Trans  formed 

Population 

1876 

6.2432 

1,356 

1880 

5.9083 

1,894 

1885 

5.4897 

2,875 

1890 

5.0712 

4,  360 

1895 

4.6526 

6,606 

1900 

4.2340 

9,991 

1905 

3.8154 

15,072 

1910 

3.3968 

22,654 

1915 

2.9783 

33,857 

1920 

2.5597 

50,194 

1925 

2,1411 

73,542 

1930 

1.  7225 

105,978 

1935 

1. 3040 

149,295 

1940 

0.8854 

204,237 

1945 

0.4668 

269,492 

1950 

0.0482 

341,225 

1955 

-0.3704 

413,674 

1960 

-0.7889 

480,835 

1965 

-1.2075 

538,360 

1966 

-1.2912 

548,496 

1967 

-1.3749 

558, 160 

1970 

-1.6263 

584,378 

1980 

-2.4634 

644,430 

1990 

-3.3006 

674,439 

2000 

-4.1377 

688,314 

Based 

on  the  following 

equation: 

Y ' fn  n - bt 


The  parameters  A and  ft  were  determined 
by  the  least  squares  method  using  the 
historical  transformed  data  from  Table  11 
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(monthly,  8 to  12  pages,  $5.50  per  year,  including  4 to  6 issues 
of  Data  Access  Descriptions). 

A simple  and  potentially  useful  method  that  addresses  this 
problem  from  the  Corps’  perspective  has  been  proposed  by  Burnham 
H.  Dodge,  consultant  to  this  study  and  former  planner  in  the  In- 
stitute for  Water  Resources.  Dodge's  method  is  qualitative,  ex- 
ploits local  sources  of  information,  and  would  appear  to  be  emi- 
nently practical  where  no  more  direct  data  are  available.  The 
method  can  be  applied  for  areas  as  small  as  a part  of  a single 
county.  While  the  method  has  not  been  actually  UBed  to  date,  it 
appears  to  deserve  a fair  trial. 

To  use  the  method,  the  forecaster  first  makes  a base-line 
forecast.  The  base-line  forecast  is  prepared  by  scaling  down  to 
the  area  of  interest  exiflting  data  from  the  next  largest  aggrega- 
tion that  includes  the  area  of  inter  ■ it. 

It  is  acknowledged  that  the  base-line  forecast  is  apt  to  give 
a distorted  picture  of  future  growth  in  the  small  area.  Localized 
factors  not  reflected  in  trends  for  the  larger  region  will  probably 
have  a substantial  impact  on  actual  future  growth  in  the  small  area. 
The  method  seeks  to  modify  the  base-line  forecast  by  systematically 
identifying  and  accounting  for  the  most  important  localized  influ- 
ences on  future  growth.  Dodge  proposes  a list  of  nine  such  local 
factors : 

• Population  density  in  the  small  area,  compared  with 
nearby  areas. 

• The  ratio  of  families  whose  heads  are  of  child-bearing 
age  to  the  totai  number  of  households  in  the  area. 

*0 


• The  extent  and  quality  of  community  facilities. 

• The  amount  of  land  available  for  future  development. 

• Evidence  of  current  community  preference  for  resi- 
dential development  or  for  industrial  development. 

• Extent  of  harmony  among  various  community  interests. 

• Personal  income  levels  in  the  area,  compared  with 
those  in  nearby  areas. 

• Tax  and  bond  capacity  to  build  additional  community 
facilities. 

• The  reputed  quality  of  the  local  school  system. 

This  list  is  meant  to  be  suggestive  rather  than  exhaustive. 
Clearly,  in  any  particular  area  not  all  factors  will  be  of  equal 
weight  in  determining  the  area's  future  growth,  Indeed,  Dodge 
argues  that  a forecaster  familiar  with  the  area  can  sift  systemat- 
ically through  such  a list  and  deride  ->w  important  each  factor 
is.  To  do  so  requires  compiling  pertinent  information  from  formal 
and  informal  local  sources,  such  as: 

• Local  and  regional  governments 

• Local  newspaper  files 

• Chambers  of  commerce 

• Business  and  social  organizations 

• School  boards 

• Long-time  residents  of  the  area. 

Having  compiled  his  list  of  crucial  local  factors  and  as  much 
pertinent  information  as  possible,  the  forecaster  can  address  three 
basic  questions  for  each  factor  considered: 
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(1)  Has  the  importance  of  this  factor  changed,,  compared 
with  the  past?  If  so,  will  that  change  have  a posi- 
tive or  a negative  influence  on  the  rate  of  future 
growth  in  the  area? 

(2)  Given  the  factor's  current  significance,  does  it 
now  tend  to  encourage  or  discourage  development  In 
the  area? 

(3)  Taking  Points  1 and  2 together,  will  this  factor 
in  the  future  be  a positive  or  a negative  growth 
factor  in  the  area? 

The  method  is  shown  in  the  form  of  an  evaluation  table  iu 
Table  13. 

In  addition  to  the  points  already  discussed,  the  table  pro- 
vides a column  in  which  the  forecaster  can  record  the  rationale 
used  in  making  estimates.  As  'indicated,  a seven-value  scale 
(-3  to  +3)  has  been  used  in  making  judgmental  weightings  of  each 
factor.  Since  the  factors  given  in  this  particular  table  number 
nine,  the  range  of  weighted  values  is  from  -27  (9  x -3)  to  +27 
(9  x +3).  A -27  score  reflects  the  forecaster's  estimate  thct 

i 

the  area  is  in  for  a severe  decline  in  growth,  a 0 score  means 
that  historic  growth  trends  are  expected  to  continue,  and  a +27 
score  Indicates  that  papulation  in  the  area  is  expected  to  boom. 

The  factors  shown  in  Table  13  all  represent  traditional 
forces  that  contribute  to  positive  cr  negative  growth  in  any 
small  area.  In  addition,  the  forecaster  must  be  alert  to  special 
novel  factors  in  the  nrea--''diocontinuitias,"  in  futurist  jargon-- 
that  could  affect  future  growth  rates.  Among  these,  the  potential 
Impact  of  the  proposed  water  resources  project  itself  should  be 
givan  particular  attention. 
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Table  11 


FACTORS  IN  POPULATION  GROWTH 


Effect  on  Population  Change 

Hlatorical  Preeant  Future  Rationale  for  Future 


Factor 

Boat 

Preaant 

Situation 

Situation 

4 cr  ■ 

Weighted 

Effect  of  Factor 

Population  deneity-- 
relation  to  other 
areai 
Above 
Same 
Balov 

X 

X 

4 

0 

-1 

Low  peat  denalty  hai 
been  poiltlva.  Preaent 
denalty  la  neutral. 
Atiaumlng  trend  will  not 
atop  auddenly,  it  will 
become  Increaalngly 
negative. 

Ratio  of  child  hear* 
Inn  familial  to 
total  population 
Greater 
Same 

Uaa 

X 

X 

• 3 

Source  of  locally  gen- 
erated population  in  a 
declining  trend, 

Infraetructure 

Adequate 

Inadequate 

X 

X 

4 

4 

4 

*1 

Record  of  adequacy  eup- 
porta  expectation  of 
ability  to  maet  neada 
of  larger  population. 

Space  aval labia 
Amp  la 
Limited 
None 

X 

X 

4 

4 

4 

+ 3 

Community  policy 
Favor  Induatry 
Favor  reeldsntlal 

X 

X 

4 

“ 

■ 2 

Employment  attracti 
more  people  than  real- 
dentlal  opportunity. 

Community  coheiion 
Common  lntereata 
Conflicting  In* 

taraati 

X 

X 

4 

-3 

Pence  and  harmony  are 
more  attractive  than 
conflict  and  contro- 
veray. 

Peraonal  Income  re 
other  areae 
Above 

Same 

Below 

X 

X 

4 

f 

+ 3 

High  peraonal  Income 
level  la  a poaltlva 
influence  in  thin  par- 
ticular area, 

Revenue  potential 
Adequate 
Inadequate 

X 

X 

- 

4 

4 

♦ 3 

Ability  to  finance  com- 
munity facllltlae  re- 
quired by  papulation 
incraaeo  la  poaltlva. 

School  ayetam 
High  quality 
Average  quality 
Low  quality 

X 

X 

0 

4 

+ 2 

Trend  pointa  to  con- 
tinued Improvement. 

Nafc  «ffcct 

♦ 1 

*3 

o 

■i 

J 


63 


The  Dodge  method  has  been  presented  here  in  terms  of  the 
individual  project  planner.  The  simplicity  of  the  method  is  such 
that  it  lends  itself  well  to  use  with  coordinating  agencies  and 
for  early,  significant  citizen  involvement  in  project  planning. 

In  conclusion,  the  foregoing  method  for  estimating  future 
growth  potential  in  a small  area  is  a simple,  qualitative,  best- 
judgment  estimation  method.  While  the  method  has  never  been 
tested  in  actual  use,  it  seems  straightforward  and  adaptable,  and 
should  be  well  worth  trying  in  those  many  situations  where  more 
direct,  rigorous  approaches  are  not  feasible. 


PATTERN  IDENTIFICATION 


General  Description 

Abstract 

Forecasting  methods  based  on  pattern  identification  seek  to 
recognize  a developmental  pattern  In  historical  data  and  to  use 
this  often  obscure  pattern  as  the  basis  of  forecasting  future 
events.  The  method  is  useful  both  for  time-series  data,  where 
more  direct  extrapolating  methods  do  not  work,  and  for  interpret- 
ing numerous  social  trends.  The  Box-Jenkins  method  1b  an  example 
of  the  former  and  Normex  forecasting  and  analysis  of  precursor 
events  are  examples  of  the  latter.  Pattern  identification  methods 
sometimes  suffer  from  a poor  data  base,  varied  interpretations, 
and  hence  questionable  reliability  of  findings. 

Definition 

It  was  Thomas  Campbell  (1777-1844)  who  first  observed  that 
"coming  events  cast  their  shadows  before."  Ever  eager  to  avoid 
the  worBt  and  exploit  the  best,  humanity  has  tried  to  discern  the 
outlines  of  what  will  be  amid  the  shadows  of  what  is.  The  results 
are  rarely  satisfying.  Mingled  and  overlapping  in  the  darkness, 
shadows  and  silhouettes  tell  us  as  much  about  what  never  was  as 
about  what  must  yet  be. 

Shifting  from  the  metaphorical  to  the  practical,  what  infor- 
mation is  there  in  shadows,  silhouettes,  and  bare  profiles?  How 
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is  it  that  we  can  recognise  a friend  viewed  through  a translucent 
screen?  The  answer  is  that  in  silhouettes  and  shadows  we  can  rec- 
ognize patterns.  Further,  if  a pattern  can  be  recognized,  what 
comes  next  often  can  be  identified.  This  ability  is  the  basis  of 
forecasting  via  pattern  identification. 

Pattern  recognition  and  prediction  are  useful  only  where  less 
direct  methods,  such  as  trend  extrapolation,  are  inadequate.  In 
the  case  of  time-series  data  with  a readily  apparent  trend,  extrap- 
olating methods  are  generally  cheaper  and  more  easily  understood 
than  more  sophisticated  methods  such  as  Box-Jenkins,  The  Box- 
Jenkins  method  is  a relatively  recent  quantitative  forecasting 
approach  designed  to  handle  complex  time-series  data  where  no 
ready  pattern  to  the  data  is  apparent.  Unlike  most  other  quanti- 
tative techniques,  Box-Jenkins  does  not  require  a clear  definition 
of  the  trend,  In  fact,  the  method  ia  intended  to  discover  the  pat- 
tern of  the  trend.  This  is  accomplished  by  multiple  iterations  of 
the  data,  with  each  iteration  providing  information  that  allows 
the  next  to  more  closely  approximate  the  actual  pattern  of  the  data. 
In  complexity,  Box-Jenkins  lies  between  multiple  regression  analy- 
sis and  computer  simulation  models.  The  method  forecasts  only  a 
single  variable. 

Normex  forecasting  ia  so  called  because  it  combines  normative 
objectives  (i.e.,  need-oriented)  with  exploratory  forecasting  (i.e., 
extrapolation  of  trends)  to  arrive  at  forecasts  fell,  to  be  superior 
to  either  normative  or  exploratory  approaches  alone.  In  effect, 
the  approach  seeks  to  combine  change  patterns  in  several  areas  to 
define  the  Joint  outcome.  A major  advantage  of  the  technique  is 
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that  it  provides  the  planner  with  a frequency  distribution  about 
some  forecasted  event.  While  the  method  is  relatively  inexpensive, 
it  does  require  the  collection  of  large  amounts  of  historical  data. 

Pattern  identification  is  also  fundamental  to  interpreting 
precursor  events,  leading  and  lagging  indicators,  and  many  kinds 
of  social  trends.  In  contemporary  futures  research,  the  analyp^s 
of  precursor  events  has  been  most  closely  identified  with  techno- 
logical, and  especially  "break-through"  forecasting.  Similarly, 
pattern  analyses  of  social  phenomena  usually  deal  with  redirections 
of  trends,  ranging  from  shifts  in  political  sentiment  to  basic 
phaee-changea  of  cultural  norms.  Social  indicators  frequently 
substitute  for  direct  measures  in  this  sort  of  work. 

Assumptions 

The  most  fundamental  assumption  in  these  forecasting  tech- 
niques is  that  events  do  have  patterns.  Second,  it  is  assumed 
that  discernible  patterns  are  harbingers  of  things  to  come--an 
assumption  that  presumes  the  past  is  indicator  of  the  future. 

Third,  in  approaches  utilizing  indicators  rather  than  direct 
measures,  assumptions  must  be  made  concerning  the  validity  and 
completeness  of  the  indicator. 

History 

Use  of  trends  to  predict  future  social  patterns  goes  back 
to  early  times.  Recent  years  have  seen  an  enormous  expansion  in 
social  trend  and  social  indicator  research,  spearheaded  by  the 
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federal  government  and  by  such  private  organizations  as  the  Russell 
Sage  Foundation  and  the  Social  Science  Research  Council. 

The  Box-Jenkins  method  emerged  from  a different  line  of  devel- 
opments. It  was  developed  in  the  late  1960s  by  Professors  G.  E. 

Box  and  G.  M.  Jenkins,  and  was  first  published  in  1970  in  their 
book,  Time  Series  Analysis. 

The  Normex  approach  was  well  described  by  Brown  and  Burkhardt 
In  1968  in  a paper  that  illustrated  the  combined  use  of  trend  ex- 
trapolation and  normative  forecasts.  Mathematical  procedures  ap- 
plicable to  the  Normex  technique  were  published  by  Blackman  (1973). 
Normex  has  been  applied  to  planning  for  jet  engines  and  the  com- 
puter memory  market.  The  technique  is  still  undergoing  development. 

Main  Uses 

Pattern  recognition  methods  are  most  useful  where  data  are 
fuzzy,  indirect,  or  so  complex  as  to  be  obscure  as  to  what  is  in- 
cluded. Social  analysis  based  on  patterns  is  used  chiefly  in  the 
fields  of 

• Public  policy  setting 

• Program  development  and  assessment 

• Long-:'ange  corporate  planning 

• Market  research. 

Precursor  studies  focus  primarily  on  technological  forecast- 
ing. Box-Jenkins  is  applicable  to  any  kind  of  problem  as  long  as 
the  desired  forecast  has  an  extended  time  span,  the  data  composing 
the  time  series  are  complex,  and  a relatively  high  degree  of 
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precision  is  both  required  and  meaningful.  It  is  also  important 
that  the  Box-Jenkins  method  provides  information  on  the  statisti- 
cal error  in  the  forecast,  independent  of  other  tents. 


To  date,  Normex  forecasting  has  been  used  largely  to  estimate 
future  markets  for  high-technology  products  and  services.  However, 
the  methodology  is  general  and  should  be  applicable,  for  example, 
to  forecasting  demand  for  recreational  facilities  at  a reservoir, 
Through  its  ability  to  forecast  both  the  mean  and  variance  asso- 
ciated with  future  technological  performance  parameters,  the  Normox 
technique  provides  the  capability  of  evaluating  the  level  of  uncer- 
tainty associated  with  a forecast.  Hence,  a measure  of  the  extent 
of  possible  error  is  presented  along  with  the  forecast. 


Limits  and  Cautions 


There  are  several  limits  and  cautions! 

« Most  basic  is  the  problem  of  assessing  the  true 
validity  of  a pattern  for  predicting.  In  social 
affairs,  no  comprehensive  theory  of  societal  change 
exists.  Hence,  all  forecasts  based  on  trends  and 
indicators  of  trends  must  be  regarded  with  caution. 

• The  fallacy  of  the  so-called  intervening  variable  is 
a trap  in  forecasting  from  precursor  events.  This 
fallacy  imputes  causative  powers  to  what  actually 

is  merely  coincidence.  (Example:  is  inflation  the 

cause  of  economic  recession  or  the  reverse,  or  were 
still  other  factors  responsible  for  both?) 

• Forecasts  based  on  time-series  data  are  only  as  good 
as  the  data.  Data  quality  is  often  more  difficult 

to  judge  in  complex  series  than  for  the  simpler  series 
typically  used  in  trend  extrapolations. 
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• The  forecaster  must  always  he  aware  of  the  limita- 
tions of  forecasts  based  on  extensions  of  past 
patterns  to  future  events. 

Other  Techniques 

Many  forecasting  methods  utilize  pattern  identification 
in  one  or  more  of  their  aspects--indeed,  pattern  recognition  is 
basic  to  the  holistic  forecasting  techniques  discussed  later. 

The  methods  mentioned  here  differ  from  the  others  chiefly  in  the 
explicitness  with  which  patterns  are  sought  out  and  extended  into 
forecasts. 

Product  or  Result 

Ideally,  pattern  identification  methods  result  in  arrays  of 
time-series  forecasts  presented  in  tabular  ur  graphical  form. 
Box-Jenkins  specifically  provides  the  most  likely  value  and  an 
"pper  and  lower  bound  to  the  probability  range.  Normex  forecasts 
are  usually  defined  in  terms  of  mathematical  uncertainty.  Support- 
ing histograms  and  graphs  often  show  (for  example)  sales  as  a func- 
tion of  a performance  parameter.  Implicit  in  such  forecasts  are 
models  or  patterns.  In  some  oases  these  patterns  are  usefully 
developed  into  complex  computerized  programs.  In  most  societal 
analyses,  an  important  part  of  the  output  is  discussion  of  assump- 
tions, rationales,  and  critical  considerations  on  which  the  fore- 
casts are  based. 
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Level  of  Detail 


There  are  no  inherent  limits.  Pattern  recognition  techniques 
can  be  applied  to  the  smallest  scale  events  or  to  the  rise  and  fall 
of  civilizations. 

Level  of  Confidence 

In  general,  these  techniques  do  not  produce  results  of  high 
confidence  because  they  customarily  deal  with  "grey"  areas  involv- 
ing many  human  intangibles.  Exceptions  occur,  however,  when  the 
data  are  simply  and  directly  tied  to  the  forecast.  Thus  the  pre- 
cursor event  of  births  this  year  confidently  indicates  much  about 
the  number  of  1-year-olda  next  year.  Results  obtained  with  Box- 
Jenklns  or  Normex  are  usually  more  accurate  than  those  obtainable 
by  less  complex  methods. 

Communicability  of  Results 

Because  these  methods  tend  to  be  used  In  obscure  situations 
characterized  by  nonevident  interrelationships,  results  are  often 
hard  to  communicate  fully.  Moreover,  special  interest  groups  tend 
to  see  in  social  statistics  what  they  prefer  to  see,  and  not  neces- 
sarily what  the  analysis  suggests.  Similarly,  results  obtained 
via  such  rather  technical  methods  as  Normex  or  Box-Jenkins  tend 
to  be  more  difficult  to  grasp  than  those  from  simpler  cxtrapola- 
tory  techniques. 
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Credibility  of  Results 


What  is  said  above  under  "Communicability  of  Results"  also 
applies  here.  Anything  difficult  to  understand  and  subject  to 
diverse  interpretation  usually  is  far  from  credible  to  critics, 
even  though  the  results  may  be  derived  with  the  greatest  care. 

Span  of  Forecasts 

In  general,  forecasts  based  on  pattern  identification  ure 
near-  to  midterm.  There  are  a few  exceptions.  Demographic  "pre 
cursor"  forecasts  can  be  made  for  considerable  periods  ahead. 

Even  more  spectacular  is  the  ability  of  astronomers  to  forecast 
the  appearance  of  comets  for  centuries  ahead.  But  few  human  af- 
fairs repeat  themselves  with  such  regularity. 

Resources  Needed 

Essentially  all  important  pattern  identification  techniques 
are  time-consuming  and  costly.  The  statistical  methods  require 
extensive  computer  manipulation  and  high  levels  of  mathematical 
skills.  The  less  rigorous  social  methods  often  require  collection 
of  hard-to-obtaln  data,  elaborate  model  building  and  testing,  and 
a good  deal  of  consultation  with  experts  in  diverse  fields. 

Procedures 

The  initial  "flash  of  genius"  in  which  the  pattern  underlying 
events  is  grasped  is  an  art  well  developed  by  many  planners.  There 
is  no  substitute  for  this  art;  very  often  the  most  learned  scholar 


in  a field  is  less  adept  at  hitting  on  the  structuring,  explana- 
tory insight  than  the  planner  who  approaches  the  problem  afresh. 
In  contrast,  the  procedures  required  to  test  the  validity  and 
comprehensiveness  of  the  pattern  and  to  develop  it  into  a defen- 
sible forecast  often  require  specialized  knowledge  the  planner 
should  properly  seek  from  consultants  rather  than  try  to  develop 
as  an  individual.  Techniques  such  as  Box-Jenkins  require  much 
mathematical  expertise;  Normex  calls  for  less,  but  even  so  it  is 
beyond  the  statistical  powers  of  many  planners. 

Case  Examples 

Box-Jenkins 

Because  the  procedures  of  Box-Jenkins  are  so  complex,  no  at- 
tempt is  made  here  to  explain  them  operationally.  In  general, 
the  method  is  pursued  in  three  main  stages,  as  shown  in  Figure  4. 

The  diagram  shows  the  basic  steps  in  applying  this  method  as 
developed  by  Professors  Box  and  Jenkins.  The  originators  of  the 
method  have  postulated  a general  set  of  models  from  which  one  is 
selected  as  the  initial  case  in  Stage  1.  In  Stage  2 this  model 
is  applied  to  the  available  data  and  a determination  is  made  as 
to  whether  the  model  is  adequate.  If  it  is  not  adequate,  the 
model  is  either  modified  or  a new  model  specified  and  Stags  2 
repeated.  After  a nui,  uer  of  iterations,  an  adequate  model  is 
produced  and  the  forecast  is  actually  generated  in  Stage  3.  If 
the  forecast  is  to  be  used  for  control  purposes,  a control  algo- 
rithm may  be  generated. 


Sttg*  i 


Stag*  2 


Stag*  3 


FIGURE  4 BOX-JENKINS  METHOD 


Those  wishing  to  use  the  Box-Jenkins  method  may  wish  to 
examine  the  "automatic  Box-JenkinB  modeling  program"  offered  by 
Automatic  Forecasting  Systems,  P.0.  Box  563,  Hatboro,  Pennsyl- 
vania 19040. 


Normex 


The  Normex  procedure,  being  a good  less  complex  mathemati- 
cally than  Box-Jenkins,  will  probably  be  more  useful  as  part  of 
the  do-it-yourself  kit  of  planners. 

Forecasting  the  recreational  requirements  at  a prospective 
Corps  reservoir  is  a commonly  encountered  problem.*  A closely 
related  problem  is  forecasting  the  distribution  of  that  attendance 
among  several  kinds  of  recreational  facilities.  Solely  for  the 
purpose  of  explaining  the  mathematical  procedure,  the  following 
example  describes  the  application  of  the  Normex  technique  to  the 
problem  of  forecasting  the  distribution  of  total  attendance  among 
recreational  activities  at  Corps  reservoirs.  Such  a forecast  is 
useful  as  a basis  for  planning  for  and  allocating  recreational 
investment  among  several  kinds  of  recreational  facilities  to  pro- 
vide an  optimum  match  to  anticipated  uBer  preferences. 

The  five  steps  involved  in  making  a Normex  forecast  of  atten- 
dance distribution  are: 

(1)  Assemble  historical  data  on  Corps  reeorvoirs  and  on 
cultural  changes  that  contribute  to  changes  in  the 
use  of  recreational  facilities.  Tabulate  important 
changes  and  project. 


IWR  Research  Report  74-1,  June  1974,  "Plan  Formulation  and  Evalu- 
ation Studies--Recreation, " presents  one  method  for  forecasting 
initial  attendance,  based  on  a comparison  between  the  prospective 
reservoir  and  attendance  at  existing  Corps  reservoirs  that  are 
most  similar  in  selected  physical  characteristics. 
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(2)  For  selected  years,  draw  histograms  of  the  frequency 
distributions  of  the  attendance  factors.  Plot  the 
data. 

(3)  For  each  of  the  histograms,  construct  cumulative 
frequency  plots  on  lognormal  probability  paper. 
Graphically  estimate  the  mean  and  standard  devia- 
tion of  the  underlying  normal  distribution. 

(4)  Plot  values  of  the  mean  and  standard  deviation  of 
the  underlying  normal  distributions  as  determined 
for  the  selected  years  versus  time,  and  extrapolate 
to  the  future  date  of  interest. 

(5)  Using  the  extrapolated  values  obtained  in  Step  4, 
along  with  projected  values  of  future  use  of  facil- 
ities obtained  in  Step  1,  forecast  the  cumulative 
distributions  for  recreational  facilities. 

To  apply  this  procedure  large  amounts  of  data  concerning  ex- 
isting reservoirs  must  be  collected  and  organized.  Pertinent  data 
from  Corps  reservoirs  would  have  to  be  updated  to  include  actual 
use  of  specific  recreational  facilities  by  type.  For  the  sake  of 
simplicity  and  clarity  the  following  limitations  and  assumptions 
in  the  example  are  noted: 

• The  data  available  for  such  an  analysis  are  at  present 
limited  and  fragmentary.  Accordingly,  the  data  used 
herein  are  entirely  hypothetical. 

» A planning  lead  time  of  five  years  1b  assumed  for  the 
availability  of  facilities.  Thus  the  target  date  for 
the  forecast  is  1980. 

• An  actual  application  would  require  forecasts  for 
each  type  of  recreational  activity.  This  example 
will  treat  only  one  type  of  activity. 

Having  observed  (via  leading  indicators,  life  ways,  or  some 
other  type  of  forecast)  a growing  need  for  water-related  facilities 
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the  planner  would  first  collect  and  then  analyze  all.  data  indicat- 
ing the  use  of  various  different  types  of  recreational  activities. 
For  the  sake  of  this  example,  we  will  assume  s/he  has  observed  an 
increase  in  the  use  of  swimming  facilities.  Moreover,  demographic 
data  indicate  a large  population  growth  in  the  age  brackets  moBt 
likely  to  use  swimming  facilities,  as  well  as  a shift  in  values 
of  the  retirement  age  population  toward  increased  use  of  swimming- 
related  recreation.  The  historical  attendance  distribution  for 
Corps  reservoirs  by  ratio  of  swimmers  to  total  attendance  is  shown 
in  Table  14  for  1960,  1965,  and  1970.  In  order  to  derive  the  dis- 
tribution of  swimming  facilities  required  in  a particular  fore- 
casted year,  the  mean  and  standard  deviation  for  the  previous 
year's  use  of  facilities  are  estimated  graphically.*  Histograms 
and  cumulative  frequency  distribution  charts  for  facility  use  in 
1960,  1965,  and  1970  are  illustrated  in  Figures  5 and  6,  respec- 
tively. 

The  values  for  the  mean  and  standard  deviation  obtained  from 
the  cumulative  frequency  distribution  charts  are  then  plotted  ver- 
sus time  and  extrapolated  (by  simple  eye-balling)  to  1980  (see 


FT 

These  values  can  also  be  calculated  using  the  following  equations. 
Note,  for  this  example  the  X values  refer  to  the  logs  of  the  ob- 
servations. 
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Figures  7 and  8).  Using  the  extrapolated  values  from  Figures  7 
and  8,  cumulative  distributions  can  be  plotted  for  each  forecasted 
year.  For  some  future  year,  say  1980,  the  cumulative  distribution 
for  swimming  facilities  is  forecasted.  This  is  done  by  plotting 
the  mean  and  the  standard  deviation  on  log  probability  paper  aa 
shown  in  Figure  9.  Using  this  projected  distribution  one  can, 
for  example,  read  that  80  percent  of  the  1980  demand  will  be  for 
a ratio  of  0.5  or  less,  and  20  percent  of  demand  will  be  for  a 
ratio  of  more  than  0.5.  This  means  that  in  designing  facilities 
for  80  percent  of  the  1980  demand  half  the  total  attendees  will. 

want  swimming  facilities.  To  design  for  peak  loads,  note  that 

/ 

at  10  percent  of  the  reservoirs  60  percent  or  more  of  the  total 
attendees  will  want  swimming  facilities.  Figure  10  shows  a his- 
togram of  this  distribution. 

The  normative  aspect  of  the  foregoing  procedure  could  be  en- 
larged by  including  data  on  attitudes,  leisure  preferences  in  each 


TIME  — vun 

•Flgura  7 It  arrlvad  at  by  plotting  tha  maan  and  tht  ttandard  davlatlon  tor  aach 
of  tha  talactad  yaart.  For  axamplt,  raad  tha  maan  valua  of  X that  eorratpondt 
to  tha  SO  paroant  valua  on  tha  probability  Mala  (Flgura  SI  and  than  plot  tha 
log  of  X, 

FIGURE  7 EXTRAPOLATION  OF  THE  MEAN* 
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FIGURE  8 EXTRAPOLATION  OF  THE  STANDARD  DEVIATION 


reservoir  area,  life  styles,  changing  family  norms,  and  so  forth. 
The  further  addition  of  attendance  distribution  and  trends  among 
recreational  activities  would  provide  the  planner  with  a broader 
basts  for  selecting  "most  similar"  existing  reservoirs  and  increase 
the  level  of  confidence  in  forecasting  the  recreation  potential 
of  a reservoir  under  study. 


82 


I 


i 


! 


.‘.j 

■;j 

i 


*m**mti#*v*i  ami**** 


FIGURE  9 FORECASTED  CUMULATIVE  DISTRIBUTION,  1980 
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RATIO;  SWIMMERS  TO  TOTAL  ATTENDANCE 
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For  example; 
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Haight 

0,8 

- 90% 
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- 80% 

O.S  to  0.8 
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FIGURE  10  HISTOGRAM  OF  1980  FORECASTED  DISTRIBUTION 
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PROBABILISTIC  FORECASTING 


General  Description 

Abstract 

Many  phenomena  for  which  forecasts  are  needed  appear  to 
change  randomly  within  limits.  Probabilistic  forecasting  methods 
use  mathematical  models  of  such  phenomena.  Numerical  odds  are 
assigned  to  every  possible  outcome  or  combination  of  outcomes. 

On  the  basis  of  such  assigned  odds,  predictive  statements  are 
made  about  the  future  behavior  of  the  phenomenon  studied.  Prob- 
abilistic forecasts  are  helpful  in  discovering  where,  how,  and 
when  a phenomenon  may  best  be  anticipated  in  the  future,  and 
where  nonpredic table  occurrences  must  be  accepted.  Such  methods 
should  not  be  used  where  adequate  mathematical  models  cannot  be 
developed,  or  when  the  results  must  be  understood  and  accepted 
by  decision  makers  untrained  in  these  specialized  techniques. 

Definition 

Probabilistic  forecasting  involves  the  development,  testing, 
and  use  of  mathematical  stochastic  models  to  predict  the  future 
behavior  of  phenomena  that  are  presumed  to  behave  in  a random 
manner.  "Stochastic"  refers  to  any  phenomenon  that  obeys  no  dis- 
cernible cause-effect  relationships  but  that  nonetheless  varies 
within  limitB.  Numbers  resulting  from  the  roll  of  dice  are  an 
example. 
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There  are  many  probabilistic  methods.  Several  of  the  best- 
known  are  briefly  described  below.  j 

Point  and  Interval  Estlmatlon-«Here.  we  estimate  the  proba- 
bility of  various  outcomes  for  a single  event.  For  example,  what 
is  the  probability  that  a river  will  reach  various  maximum  annual 
water  levels? 

Monte-Carlo  Slmulatlon--In  using  this  method,  we  define  a 
process  of  interest  as  consisting  of  a set  of  possible  events. 

Then,  invoking  a process  analogous  to  roulette,  we  go  through 
many  rounds  in  which  various  combinations  of  possible  events  are 
thrown  out  at  random.  By  keeping  careful  track  of  the  various 
combinations,  we  are  able  to  estimate  relative  probabilities  and 
so  to  make  at  least  some  predictions  about  future  outcomes.  The 
technique  has  been  applied  to  estimate  the  probability  of  rainfall 
or  of  flood. 

Markov  Processea--Thi8  method  assumes  that  events  are  ordered 
in  chains  (Markov  chains).  A corollary  assumption  is  that  there 
is  some  estimable  probability  that  a given  event  will  be  succeeded 
by  another  given  event.  This  is  called  the  transition  probability. 
The  method  also  assumes  that  the  amount  of  time  required  to  make 
the  transition  from  one  event  to  its  successor  may  vary,  and  that 
the  probabilities  of  this  transition  time  can  be  estimated.  From 
this  flows  the  final  estimate,  namely  the  long-run  probability 
that  the  process  will  be  in  any  given  state  as  defined  by  events. 
The  method  is  applicable,  for  example,  in  estimating  demand  at  a 
recreational  facility,  river  traffic,  and  all  kind?  of  arrival 
and  servicing  problems. 


Non-Markov  Processes--Markov  processes  begin  by  assuming  a 


certain  event  and  go  on  to  estimate  what  could  happen  next.  Non- 
Markov  processes  make  a different  assumption  about  chains  of  events. 
The  non-Markov  assumption  is  that  subsequent  transition  probabil- 
ities are  dependent  on  previous  transition  probabilities.  This 
approach,  for  example,  offers  a means  of  reassessing  the  prospects 
for  building  a bridge  given  new  priorities  among  interested  parties. 

Parametric  Sensitivity  Analysis  (PSA) --Any  process  or  project 
proposal  can  be  defined  as  a series  of  inputs--men,  money,  mate- 
rials, technology,  and  so  on.  PSA  offers  a means  by  which  the 
relative  importance  of  each  input  can  be  estimated.  Depending 
on  the  situation,  no  matter  how  much  an  input  may  vary,  its  impact 
on  the  ultimate  outcome  may  be  ■’.rucial,  moderate,  or  trivial. 

After  PSA  has  identified  those,  inputs  whose  impact  must  be  trivial 
no  matter  how  widely  they  may  vary,  such  inputs  can  be  treated  as 
deterministic  constants.  This  approach  permits  the  forecaster  to 
concentrate  his  attention  on  those  inputs  known  to  be  crucial  to 
the  ultimate  outcome.  PSA  is  useful  in  all  sorts  of  design  prob- 
lems in  which  some  key  parameter  1b  expected  to  change.  These 
range  from  design  of  recreational  facilities  to  organizational 
structures. 

Inventory  Theory--ln  many  situations  — for  example,  in  ware- 
house management  or  in  capital  budget  £orecasting--it  is  necessary 
to  estimate  when  replacements  will  be  needed,  how  many  will  bo 
needed,  and  how  much  time  will  intervene  between  placing  an  order 
and  receiving  it.  Inventory  theory  affords  a framework  of  concepts 
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and  procedures  by  which  such  estimates  can  be  made  probabilisti- 
cally, The  approach  applies  to  intangibles,  such  as  maintenance 
schedules,  as  well  as  to  the  inventory  of  supplies. 

Queueing  Theory--In  a supermarket,  a bank,  or  a construction 
project  staging  area,  lines  of  customers,  equipment,  or  material 
arrive  at  critical  points  for  service,  handling,  or  processing. 

In  designing  service,  handling,  or  processing  facilities  it  is 
essential  to  estimate  how  often  how  many  inputs  will  arrive,  and 
hov  long  it  will  take  to  handle  an  input.  Queueing  theory  pro- 
vides statistical  methods  for  making  such  estimates.  The  theory 
also  enables  one  to  forecast  what  effects  would  be  felt  if  the 
number  of  service  channels  were  increased  or  decreased  at  a given 
point,  or  if  any  one  of  various  policies  were  used  to  determine 
which  Inputs  should  receive  attention  first. 

Decision  Analysis--Thls  is  the  best-known  probability  tech- 
nique. By  combining  aspects  of  systems  analysis  and  statistical 
decision  theory,  the  method  builds  a "decision  tree"  aimed  at  show- 
ing the  user  how  to  approach  a complex,  dynamic,  and  uncertain  sit- 
uation in  a logical  manner.  The  tree  permits  mathematical  modeling 
of  the  decision,  and  quantitative  evaluation  of  the  various  action 
options. 

Risk  Analy8ls--ThlB  is  best  known  for  its  applications  in 
the  space  program.  Such  programs  deal  with  extremely  large,  ex- 
tremely complex,  one-of-a-kind  systems.  Furthermore,  because  of 
their  size  and  complexity  such  systsms  cannot  be  made  in  multiple 
copies,  and  success  in  their  one-time-only  operation  is  vitally 
Important. 
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Where  such  unusual  situations  demand  and  justify  it,  risk 
analysis  can  be  uniquely  helpful.  Two  basic  approaches  are  used, 
the  "event  tree"  and  the  "fault  tree"  approach.  The  event  tree 
approach  is  sequence  dependent.  First,  building  a complex  sym- 
bolic mathematical  map  of  the  system,  an  "initiating  event"  is 
selected  frr  study.  Statistical  analysis  procedures  are  then 
invoked  to  estimate  the  failure  probabilities  of  various  protec- 
tive devices  or  dependent  components  for  each  alternative  event 
path.  The  fault  tree  is  an  analogous  but  somewhat  more  complex 
approach.  Beginning  with  a given  fault,  the  probabilities  and 
consequences  of  subsequent  impacts  on  the  total  system  can  be 
predicted.  Because  of  its  rigor,  complexity,  and  cost,  risk 
analysis  is  justifiable  only  in  relatively  high-cost,  high-risk, 
high-reliability  projects,  and  not  always  then.  The  method  is 
applicable  only  if  the  system  studied  can  be  completely  and  rigor- 
ously specified.  Examples  of  Corps  use  might  be  control  gates 
and  levees  for  flood  control  or,  more  obviously,  the  chain  of  sen- 
sors, switches,  breakers,  power  sources,  and  the  like,  for  spill- 
way gates  and  hydro-generator  systems. 

Optimization  Methods--These  are  increasingly  used  in  project 
.nd  program  planning  management.  Simply  stated,  optimization  seeks 
to  secure  the  most  desired  results  with  the  fewest  undesirable 
consequences  and  the  least  expenditure  of  resources  and  effort. 
While  optimization  is  perhaps  more  a planning  and  management  tool 
than  a forecasting  tool,  it  clearly  can  be  used  for  forecasting 
purposes.  To  use  the  approach,  one  specifies  the  desired  outcome 
(the  normative  future,  a forecaster  would  call  it).  Then  every 
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possible  combination  of  alternatives  is  identified  through  which 
the  desired  outcome  might  be  attained.  Finally,  all  alternatives 
are  assessed  against  each  other  to  determine  which  should  be  most 
effective,  as  measured  against  some  set  of  performance  crl'-'ia. 
This  method  could  be  applied  to  design  recreational  facilities  to 
serve  a specified  number  of  people  at  minimum  fOBt  or  to  select 
the  optimum  sequence  of  steps  for  achieving  a given  water  quality 
in  a stream. 


Assumptions 


In  using  probabilistic  ant-  . -<*d  methods,  It  is  assumed 

that: 

• The  phenomenon  of  interest  can  be  described  or  defined 
in  terms  of  associated  events. 

• Every  event  considered  has  a discrete,  definable 
outcome. 

• Logical  procedures  plus  a knowledge  of  inherent  struc- 
tures and  limits  can  be  applied  to  estimate  the  like- 
lihood of  every  possible  outcome. 

• Increased  or  improved  estimates  of  possible  outcomes 
can  be  translated  into  predictions  about  the  future 
states  or  behavior  of  the  phenomenon  with  which  the 
events  studied  are  associated. 


History 

Basic  knowledge  and  use  of  probabilistic  forecasting  methods 
can  be  traced  to  ancient  times.  In  the  contemporary  technical 
sense,  most  of  the  methods  mentioned  and  discussed  here  have  their 
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origins  in  the  World  War  il  period,  and  especially  in  operations 
research.  Risk  analysis  and  optimization  are  more  recent  off- 
shoots,  stemming  from  the  increasing  use  of  digital  computers 
and  such  technological  efforts  as  weapons  development  and  the 
space  program. 

Main  Uses 

Two  basic  postures  can  be  taken  toward  the  future,  acceptance 
and  mastery.  By  accepting  what  1b  inevitable  ahead  of  time,  we 
can  accommodate  ourselves  to  it  as  much  as  possible.  By  control- 
ling what  can  be  controlled,  we  can  work  toward  attainment  of  de- 
sired outcomes. 

In  most  cases,  some  mixture  of  both  postures  is  necessary. 
While  we  cannot  shape  the  future  exactly  and  always  to  our  aspi- 
rations, neither  are  we  often  totally  the  captive  of  blind  fate. 
The  difficulty  la  to  figure  out  in  each  situation  what  is  and  is 
not  likely  to  happen,  so  that  we  can  come  up  with  the  best  mix 
of  acceptance-mastery  strategies. 

It  is  in  this  situation  that  probabilistic  methods  are  most 
helpful.  If  their  end  products  are  less  than  certain,  they  are 
more  than  nothing  at  all.  Oftentimes,  a knowledge  of  the  odds 
is  in  itself  enough  to  enable  us  to  have  our  way.  The  Apollo 
program  was  possible  and  successful  because  probabilistic  fore- 
casting enabled  us  to  assess  risks  and  make  Investments  accord- 
ingly. 
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Limits  and  Cautions 


It  is  quick,  simple,  and  inexpensive  to  resolve  a forecast 
by  tossing  a coin.  At  the  other  extreme,  millions  of  dollars  and 
many  highly  skilled  person-years  of  efforts  may  be  invested  in  a 
risk  analysis  project.  In  considering  the  use  of  probabilistic 
forecasting  methods,  we  must  be  sure  that  the  method  considered 
is  adequate  and  appropriate  for  the  task  at  hand. 

The  costs  and  other  requirements  for  probabilistic  forecast- 
ing rise  rapidly  with  complexity.  Such  being  the  case,  users  are 
well  advised  to  begin  by  making  rapid,  rough  approximation  esti- 
mates. Often,  the  results  from  such  quick-and-dirty  procedures 
will  be  almost  as  useful  as  the  outcomes  of  far  more  elaborate 
efforts.  In  any  case,  first-pass  estimates  should  shed  more  light 
on  the  nature  of  the  forecasting  challenge,  which  in  turn  will  pro- 
vide guidance  as  to  which  of  the  more  sophisticated  methods  avail- 
able is  most  appropriate. 


Other  Techniques 

Many  other  forecasting  methods  (especially  Trend  Extrapolation) 
may  be  used  in  place  of  probabilistic  approaches,  depending  on  the 
particular  situation.  In  cases  where  numerical  estimates  are  im- 
possible or  of  dubious  validity,  the  qualitative  methods  described 
in  this  Handbook  are  useful, 
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Product  or  Result 


\ 


Because  the  number  and  variety  of  these  methods  Is  great, 
the  end  product  may  take  many  forms:  for  Instance,  sets  of  prob- 

ability matrices,  decision  trees,  fault  trees,  interactive  com- 
puter models. 

■ Level  of  Detail 

The  elements  used  in  reaching  probabilistic  conclusions  are 
often  exceedingly  detailed.  Some  decision  trees,  for  example, 
require  hundreds  of  separate  units.  In  contrast,  the  "answers" 
yielded  by  these  methods  typically  are  slmole  ranges  of  proba- 
bility. 
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Level  of  Confidence 

Probabilistic  methods  are  typically  used  where  the  number  of 
possible  outcomes  is  large,  and  the  probability  of  any  given  out- 
come is  contingent  on  many  factors.  By  the  very  nature  of  the 
topics  to  which  they  are  applied,  probabilistic  forecasts  are  a>t 
to  command  only  limited  confidence.  Fortunately,  such  methods 
normally  use  built-in  statistical  measures  of  uncertainty.  Per- 
sons trained  in  such  methods  usually  can  agree  on  the  validity 
of  confidence  measures.  When  the  application  of  Buch  measures 
suggests  the  reliability  of  a study  and  when  a few  among  many 
outcomes  seem  much  more  certain  than  the  others,  then  a generally 
high  level  of  confidence  may  be  enjoyed  by  a probabilistic  fore- 
cast. Unfortunately,  such  cases  are  not  typical. 
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Communicability  of  Results 

Most  probabilistic  methods  used  in  contemporary  futures  fore- 
casting are  relatively  sophisticated  and  technical.  The  results 
of  such  forecasts  may  be  incomprehensible  to  persons  inexperienced 
with  the  particular  technique.  The  significance  of  probabilistic 
forecasts  will  certainly  be  lost  on  persons  who  lack  a basic  grasp 
of  statistical  and  probabilistic  concepts. 

Credibility  of  Results 

Credibility  and  communicability  are  intimately  related.  Few 
people  who  have  something  at  stake  are  likely  to  accept  as  credible 
that  which  they  cannot  comprehend.  As  mentioned  above,  a typical 
probabilistic  forecast  may  be  difficult  to  communicate  to  persons 
not  trained  in,  such  methods.  For  that  reason,  the  most  sophisti- 
cated probabilistic  forecasts  are  probably  limited  to  exchange 
among  professionals.  It  then  becomes  their  task  to  provide  cred- 
ible interpretations  to  their  respective  clienteles. 

Span  of  Forecasts 

Not  every  probabilistic  forecast  is  placed  in  a specific 
framework.  Risk  analyses,  for  example,  provide  sequential  fore- 
casts not  tied  to  any  particular  date.  When  specific  time  spans 
are  involved,  their  location  and  duration  will  be  determined  by 
the  intended  uses  of  the  forecast.  Many  NASA  Apollo  forecasts, 
for  example,  were  based  on  normative  target  dates  for  missions-- 
dates  often  set  years  in  advance. 
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Resources  Needed 


For  probabi.li.3tic  forecasts  of  any  scope  or  sophistication, 
at  least  one  appropriately  trained  and  experienced  person  is  es- 
sential. In  actual  fact,  a few  person-weeks  to  a few  person-years 
time  may  be  required,  spread  over  a period  of  weeks  or  months,  and 
often  involving  extensive  use  of  computer  facilities.  Accordingly, 
even  minimum-effort  forecasts  may  cost  thousands  of  dollars,  while 
more  ambitious  projects  may  well  coat  tens  or  even  hundreds  of 
thousands  of  dollars. 

Procedures 

Planners  with  a reasonable  grasp  of  statistical  mathematics 
will  find  most  probabilistic  procedures  (such  as  queueing  theory 
or  decision  analysis)  easily  within  their  powers.  Unfortunately, 
some  procedures,  including  risk  analysis  and  aspects  of  Markov 
and  non-Markov  processes,  are  sufficiently  specialized  to  require 
help  from  experts. 

Case  Example 

Queueing  Theory 

The  following  example  shows  how  queueing  theory  could  be  ap- 
plied to  forecast  waiting  time  at  canal  locks,  The  purpose  is  to 
define  lock  systems  of  optimum  utility  for  a given  traffic  situa- 
tion. The  data  given  in  the  example  are  hypothetical  but,  in  gen- 
eral, accord  with  experience. 


The  procedure  involves  five  steps,  described  below. 


Demand— First  the  statistical  probability  distribution  for 
demand  on  the  system  must  be  estimated.  This  distribution  might 
depend  on  time  of  day  or  year..  A typical  distribution  is  shown 
in  Figure  11. 


NUMBER  Of'  UNITS  ARRIVING  FOR  LOCKAGE 
AT  ONE  TIME  — btrgst,  tovw,  »to, 

FIGURE  11  PROBABILITY  DISTRIBUTION  FOR  DEMAND 


Transit  Time-Next,  the  statistical  probability  distribution 
for  lock  transit  times  for  an  individual  unit  for  a particular 
type  of  lock  must  be  estimated.  Clearly,  this  estimate  will  re- 
quire analyses  of  different  types  of  locks,  each  type  having  spe- 
cial characteristics.  Thus,  there  may  be  as  many  distributions 
as  there  are  suitable  lock  types.  Figure  12  illustrates  hypothet- 
ical patterns  for  two  types. 
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FIGURE  12  PROBABILITY  DISTRIBUTION  FOR  TRANSIT  TIMES 


Queueing  Equation--Queuelng  theory  equations  that  use  demand 
and  look-transit,  time  statistical  distributions  such  as  those  shown 
in  Figures  11  and  12,  are  now  obtained.  These  equations  are  gener- 
ally found  in  operations  research  or  queueing  theory  literature  or 
can  be  derived  by  mathematicians.  The  example  below  assumes:  a 

single  lock,  that  the  arrival  times  are  distributed  according  to 
the  Poisson  distribution,  and  that  the  transit  times  are  distributed 
according  to  the  exponential  distribution. 
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where:  a - the  average  arrival  rate  (units/minute) 

1 / M-  = the  average  transit  time  (minutes/unit) 

(Note  p.  and  a can  be  estimated  from  the  statistical 
distribution  shown  in  Figures  11  and  12.) 

L = the  expected  line  length  (queue  plus  lock) 

= the  expected  queue  length 

W -•=  expected  waiting  time  including  tranBit  time 

W = expected  waiting  time  in  the  queue. 


Other  Concepts--Al ternative  system  concepts  can  be  compared 
on  the  basis  of  the  calculations  given  in  "Queueing  Equation" 
above.  Other  calculations  can  be  made  relative  to  cost  or,  as 
illustrated  in  Figure  13,  with  respect  to  the  probability  of  an 
arriving  unit  having  to  wait  different  times. 
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FIGURE  13  PROBABILITY  DISTRIBUTION  FOR  WAITING  TIMES 
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FIGURE  14  COST  ANALYSIS  OF  WAITING  TIMES 


Optimum  Desi^n--0n  the  basis  of  the  foregoing  analyses  it 
is  possible  to  specify  the  optimum  system  of  locks  as  measured 
in  total  costs.  This  analysis  could  take  the  form  shown  in  Fig- 
ure 15. 


TOTAL  COST 


Introduction 


This  section  of  the  Handbook  discusses  forecasting  methods 
based  upon  models  or  simulations  of  the  phenomena  to  be  forecast. 
The  specific  techniques  described  are  dynamic  models,  cross-impact 
analysis,  KSIM,  input-output  analysis,  and  policy  capture.  As  a 
group  these  can  be  referred  to  as  structural  models.  Each  can  be 
used  as  a forecasting  technique  individually.  In  addition,  three 
of  the  five  can  be  used  to  provide  specialty  inputs  to  the  others, 
as  diagrammed  below: 

Quantltatlvt  Structure  Quslluttv*  Structure  Normative  Structure 


FIGURE  18  STRUCTURAL  MODELS 

Structural  models  are  so  called  because  they  demonstrate  the 
interactions  of  the  separate  elements  of  a system  or  problem,  as 
well  as  their  combined  overall  effect.  Such  models  are  helpful 
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in  attaining  a broad  perspective  and  a better  grasp  of  the  total- 
ity of  a problem,  in  foreseeing  effects  Chat  might  otherwise  be 
overlooked,  and  in  anticipating  (or  forecasting)  public  reaction 
to  alternative  problem  solutions • 

Structural  modeling  can  range  in  complexity  and  difficulty 
from  an  easily  accomplished  graphic  display  of  the  qualitative 
relationships  among  problem  elements,  to  a comprehensive,  formal 
dynamic  model  that  deals  with  quantitative  relationships  over  time 
and  requires  special  skills  and  computerisation. 

The  task  of  modeling  a system  begins  with  conceptualizing  the 
system.  The  modeler  first  must  establish  the  boundary  of  the  sys- 
tem in  both  time  and  space.  A useful  tool  for  describing  system 
structure  is  the  feedback  loop.  Feedback  loops  provide  a qualita- 
tive picture  of  the  system  structure.  For  some  purposes,  this 
structure  must  then  be  mapped  into  a quantitative  or  formal  mathe- 
matical model.  In  order  to  quantify  the  model,  specific  numerical 
values  are  required  for  the  parameters  identified  in  the  system 
structure.  The  system  dynamics  model  builder  places  heavy  reli- 
ance on  experts  in  the  field  to  supply  these  data, 

The  dynamics  of  a given  system  are  produced  by  the  action  of 
feedback  loops  within  the  model.  As  presented  by  Anderson,  Ander- 
son, and  Ferree  (1972): 

A feedback  loop  traces  qualitative  cause-end-effect 
relationships  from  a given  variable  back  to  itself. 

For  example,  population,  the  stock  of  people  in  a sys- 
tem, ia  controlled  by  two  rates,  births  per  year  and 
deaths  per  year.  But  these  rates  themselves  depend  on 
the  population  as  shown  in  Figure  [17]. 
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GIVING  BIRTH  EACH  YEAR)  DYING  EACH  YEAR) 

FIGURE  17  FEEDBACK  LOOPS  FOR  POPULATION  GROWTH 


For  a given  fertility  (fraction  of  the  population  giving 
birth),  more  births  make  more  population,  and  more  popu- 
lation makes  more  births;  the  opposite  is  true  for  deaths. 
Hence,  the  population  responds  to  the  influences  of  a 
positive  feedback  loop  and  a negative  feedback  loop.  If 
the  positive  feedback  loop  dominates  (fertility  is  greater 
than  mortality),  then  the  population  will  grow  exponen- 
I | tially  without  bound.  If  the  negative  feedback  loop  dom- 

| inates,  then  the  population  will  decline--ultimately  to 

f zero.  The  growth  of  capital  follows  the  same  pattern, 

| but  investment  replaces  births,  and  depreciation  replaces 

. | deaths. 


The  exercise  of  constructing  a model  can  be  in  itself  valuable 
to  a planner  as  an  aid  in  anticipating  the  strengths,  weaknesses, 
and  consequences  of  possible  solutions  to  a problem.  Even  qualita- 
tive structuring  requires  identification  of  the  relevant  problem 
elements,  specification  of  the  relationships  (direct  or  inverse) 
between  sequential  problem  elements,  and  tracing  out  the  system 
structure,  including  its  feedback  loops.  The  resulting  display 
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is  analogous  to  a block  diagram  o£  an  electronic  circuit.  The 
following  description  outlines  the  procedure  and  conventions  used 


System  Elements  and  Seouance--All  problem  elements  that  have 
significant  effects  (symbolised  hare  by  letters)  must  be  identi- 
fied and  arranged  in  the  sequence  of  their  interaction:* 


A 


t 


J 


Qualitative  Relationahipa--Theae  are  indicated  by  a plus  (+) 
at  the  head  of  the  arrow  for  a direct  cause-effect  (that  is,  an 
Increase  in  A causes  an  increase  in  B),  or  by  a minuB  (-)  for  an 
Inverse  cause-effect,  (that  is,  an  increase  in  A causes  a decrease 
in  B). 

DIRBCTt  ■■■■■»  + INVERBBl  - 

Positive  Loop- -A  positive  loop  is  one  in  which  a change  in 
one  problem  element  is  amplified  by  the  feedback  loop,  and  is 
identified  as  a loop  containing  either  no  inverse  relationships 
(-)  or  an  even  number  of  inverse  relationships: 


The  above  loop  is  read  as  follows:  As  A increases  B increases, 

as  B increases  G decreases,  as  C decreases  D Increases,  as  D in- 
creases E increases,  as  E increases  A Increases.  Conversely,  if 
A decreases,  the  loop  effect  is  to  further  decrease  A. 


The  ucual  format  is  a curved  and  rounded  conglomeration  (see 
Figure  18,  Feedback  Loop  Diagram  for  the  New  England  Water  Model 
shown  in  the  Case  Example  of  this  section). 


Negative  Loop- -A  negative  loop  is  one  In  which  a change  in 

• V 

one  problem  element  is  attenuated,  and  is  identified  as  a loop 
containing  an  odd  number  of  Inverse  relationships: 


The  above  loop  is  read  as  follows:  as  A increases  B increases, 

as  B increases  C decreases,  as  C decreases  D increases,  as  D in' 
creases  E decreases,  as  E decreases  A decreases. 

In  structuring  the  model,  it  is  necessary  to  recognize  that 
different  cause-effect  relationships  may  exist  between  problem 
elements.  These  relationships  can  be  illustrated  with  loops,  as 
in  dynamic  models,  or  in  a matrix  as  in  cross-impact  and  KSIM. 
For  instance,  some: 

• Go  in  one  direction  only  (e.g.,  precipitation  causes 
runoff  but  runoff  does  not  affect  precipitation). 

• Run  in  both  directions  (e.g.,  in  the  usual  situation, 
environmental  quality  inhibits  development  and  devel- 
opment degrades  environmental  quality). 

• Are  valid  only  between  certain  limits  or  may  reverse 
beyond  certain  limits  (e.g.,  quality  of  life  may  be 
enhanced  by  population  Increase  un  to  seme  point  and 
degraded  by  population  increase  beyond  that  point). 

• Problem  elements  have  no  relationships,  or  at  leaBt 
none  of  consequence  to  the  problem. 

• Problem  elements  may  have  relationships  to  more  than 
one  other  element  and  may  therefore  form  a subsystem 
within  the  overall  system. 
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DYNAMIC  MODELS 


General  Description 

Abstract 

Dynamic  models  of  complex,  nonlinear  systems  are  extremely 
useful  for  forecasting  futures  resulting  from  Interacting events. 
The  simulation  model,  which  is  usually  numeric,  reveals  the  evolu- 
tion of  systems  through  time  under  specified  conditions  of  feed- 
back. By  changing  equations  or  adding  interacting  trends,  a large 
number  of  possible  futures  can  be  explored  in  computer  runs.  Dy- 
namic models  are  also  helpful  in  gaining  qualitative  insight  into 
the  interactions  of  system  elements. 

Among  many  applications,  dynamic  models  have  been  used  to  . 
suggest  an  overall  framework  whereby  water  supply  and  water  qual- 
ity can  be  related  to  broad  considerations  of  population,  employ- 
ment, investment,  and  life  style.  The  well-known  Limits  to  Growth 
work  utilized  dynamic  models.  Dynamic  models  require  extensive 
time,  resources,  and  skills  on  the  part  of  the  developers. 

Definition 

A dynamic  model  is  a formal  model  that  allows  the  changes  in 
system  attributes  to  be  derived  as  a function  of  time.  The  behav- 
ior of  a dynamic  system  is  generated  within  feedback  loops. 

Usually,  numeric  simulation  methods  are  used  to  solve  the 
problems  posed  by  dynamic  models.  Basically,  dynamic  models  con- 
sist of  a number  of  reservoirs,  or  levels,  interconnected  by  flow 
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paths.  The  rates  of  flow  are  controlled  by  decision  functions 
that  depend  upon  conditions  in  the  system.  The  levels  represent 
the  accumulation  of  various  entitles  In  the  system.  Rates  are 
defined  to  represent  the  instantaneous  flow  to  or  from  a level. 
Decision  functions  or,  as  they  are  also  called,  rate  equations 
determine  how  the  flow  rates  depend  upon  the  levels. 

Assumptions 

A system  dynamics  model  makes  explicit  assumptions  about  how 
decisions  control,  for  example,  the  rate  of  flow  of  capital,  re- 
sources, manpower,  social  goods,  or  any  other  entity  specified  in 
the  model.  These  assumptions  are  stated  in  the  form  of  decision 
variables,  or  rates,  and  must  be  formulated  by  mathematical  equa- 
tions indicating  how  the  decision  or  rate  depends  upon  the  per- 
ceived state  of  the  system  at  a given  instant  in  time.  A system 
dynamics  model,  thus,  is  primarily  a representation  of  how  the 
state  of  a system  influences  subsequent  changes  in  the  state  of 
that  system. 

History 

The  dynamic  modeling  technique--known  as  system  dynamics-- 
was  developed  into  its  present  form  by  Professor  Jay  Forrester 
and  his  co-workers  at  Massachusetts  Institute  of  Technology  in 
the  early  ’9608,  following  on  earlier  work  by  a variety  of  scholars. 
There  have  been  several  applications  of  the  technique  and  numerous 
publications  on  it.  Entire  books  either  devoted  to  or  based  on 
the  technique  Include:  Industrial  Dynamics  (Forrester,  1961), 
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Urban  Dynamics  (Forrester,  1967),  World  Dynamics  (Forrester,  1971), 
Limits  to  Growth  (Meadows  et  al.,  1972).  More  recently,  Mankind 
at  the  Turning  Point  (Mesarovic  and  Pestel,  1974)  contains  large 
elements  of  dynamic  modeling,  Many  types  of  dynamic  models  have 
been  utilized  to  analyze  water  resource  problems. 


Main  Uses 

A system  dynamics  model  is  used  to  assess  the  consequences 
of  action  taken  within  a system  and  to  test  the  alternatives  open 
to  policy  makers  and  planners.  Because  system  dynamics  is  a simu- 
lation methodology,  it  is  possible  to  test  the  sensitivity  of  the 
model  to  the  parameters  that  quantify  the  model--that  is,  to  assess 
how  important  a particular  parameter  is  in  the  consequences  that 
the  model  projects  for  the  system.  Sensitivity  tests  have  two 
useful  functions:  first,  they  indicate  where  more  research  is 

needed  to  allow  definitive  assessments  of  the  system's  future; 
second,  they  indicate  points  in  the  structure  of  a system  where 
a planning  or  policy  change  is  most  effective. 

Aside  from  formal  dynamic  models  that  develop  the  quantita- 
tive interaction  of  system  elements  over  time,  the  concept  has 
great  value  for  planning  as  a means  for  gaining  insight  into  the 
interaction  of  system  elements  in  a qualitative  sense.  To  do  this, 
it  is  merely  necessary  to  identify  the  elements  and  graphically 
trace  out  the  direct  and  inverse  relationships.  Such  a diagram 
can  Berve  as  a communication  tool  that  highlights  desirable  or 
undesirable  effects,  and  can  also  point  out  relationships  that 
should  be  examined  with  particular  care. 


Limits  and  Cautions 


Clearly,  no  model  of  an  involved  social  process  can  be  com- 
plete. Indeed,  no  comprehensive  theory  exists  for  many  subjects 
against  which  to  teat  the  model  for  completeness.  Hence,  there 
is  always  danger  that  the  model  omits  critical  factors  or  that 
relationships  among  factors  are  Incorrectly  hypothesized.  Even 
if  the  model  itself  is  sufficiently  complete  and  sound,  it  is 
often  difficult  to  provide  a quantitative  formulation  for  a deci- 
sion variable  or  rate.  The  commitment  of  time  and  resources  is 
significant.  Feedback  loops  must  be  designated  and  each  control 
factor  specified.  Equations  must  be  developed  for  all  rates  and 
flows.  Moreover,  this  methodology  requires  a large  amount  of  data 
and  an  experienced  model  builder  skilled  in  systems  dynamics  and 
simulation. 

Other  Techniques 

System  dynamics  is  one  of  the  moBt  developed  forms  of  simula- 
tion for  major  systems.  KSIM  is  often  referred  to  as  a poor  man's 
system  dynamics,  but  it  does  not  offer  the  sophistication  of  the 
Forrester  technique.  Another  simplified  system  dynamic  procedure 
is  QSIM  (Wake land,  1975). 

Product  or  Result 

The  results  of  a dynamic  model  are  a series  of  graphs  illus- 
trating the  growth  and  decline  of  the  system  variables.  The  prod- 
uct presents  the  results  of  various  alternatives  as  they  compete 
for  the  defined  resources. 


Ill 


Level  of  Detail 


While  the  feedback  loops  in  a dynamic  model  usually  charac- 

A* 

terize  broad  concepts,  such  as  water  quality,  the  parameters  in- 
volved in  the  definition  of  the  water  quality  loop  may  be  extremely 
detailed  and  include  such  entities  as  dissolved  oxygen,  required 
treatment,  investment,  and  capital  coats.  The  output  display  usu- 
ally illustrates  change  in  the  levels  of  major  variables,  such  as 
the  level  of  dissolved  oxygen  attained  for  various  treatment  plant 
costs. 

Level  of  Confidence 

The  validity  of  the  model  rests  as  much  on  the  acceptance  of 
its  assumptions  as  on  any  quantitative  test.  Confidence  levels 
can  often  be  raised  by  showing  how  a model  can  successfully  simu- 
late the  past.  It  perhaps  should  be  noted  that  people  sometimes 
become  enamored  of  models  and  tend  to  forget  the  severe  limitations 
under  which  any  model  of  major  social  spheres  must  operate. 

Communicability  of  Results 

Dynamic  models  rely  heavily  on  feedback  loops  to  illustrate 
basic  model  structure.  While  these  are  usually  good  display  devices, 
detailed  models  often  require  extensive  examination  and  explanation 
to  gain  full  understanding.  The  output  graphics  are  presented  in 
such  a way  as  to  facilitate  assessment  trade-offs  between  alterna- 
tives and  are  usually  understood  with  ease. 
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Credibility  of  Results 


The  Forrester /Meadows  dynamic  modeling  technique  (used  in 
Limits  to  Growth)  is  one  of  the  most  commented  upon  in  the  fore- 
casting literature.  Criticisms  of  it,  although  numerous  and  vehe- 
ment, relate  less  to  the  theory  of  the  model  than  to  the  specific 
selection  or  omission  of  factors  in  the  model.  Dynamic  modeling 
is  extremely  popular  and  seems  sure  to  be  utilized  to  an  increas- 
ing degree  in  the  future. 

Span  of  Forecasts 

Dynamic  models  are  designed  to  produce  long-range  forecasts. 
While  most  dynamic  models  simulate  changes  for  at  least  50  years, 
the  technique  can  accommodate  both  longer  and  shorter  forecast 
periods. 

Resources  Needed 

Dynamic  models  usually  require  large  amounts  of  data  in  tabu- 
lar form.  Often  the  extensive  data  requirements  present  problems 
and  are  time  consuming.  A team  approach  is  recommended  to  develop 
a dynamic  model.  Because  the  interaction  between  modeler  and  field 
expert  must  be  close  in  both  the  conceptual  and  data  collection 
steps  of  model  building,  it  is  important  for  the  two  to  work  to- 
gether throughout  the  modeling  process.  In  this  way  the  model's 
"client  respondent"  easily  grows  into  the  model's  "user  expert," 
and  the  model  becomes  an  implementable  practice!  tool  rather  than 
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an  isolated  or  sterile  exercise.  Unfortunately,  the  time  require- 
ment for  developing  such  a model  is  great  and  thus  it  is  not  usu- 
ally feasible  for  the  decision  maker  to  participate. 

A computer  is  required  to  carry  out  the  computations  of  the 
simulation.  While  a DYNAMO  compiler  is  ideally  suited  for  the 
simulation,  it  can  be  run  on  a more  standard  system,  typically 
FORTRAN  or  BASIC. 

In  general,  a minimum  of  six  months  is  required  to  collect 
the  data,  develop  the  feedback  loops,  and  test  a dynamic  model. 
Minimum  costs  are  thus  in  the  tens  of  thousands  of  dollars.  Com- 
puter co3ts  for  running  the  simulation  are  small  compared  with 
the  development  costs. 

Procedures 

A planner  not  familiar  with  dynamic  modeling  would  do  well 
to  enlist  the  aid  of  one  experienced  with  the  technique.  The 
planner  may  very  well  be  the  principal  architect  of  the  model 
but  he  will  need  help  in  following  conventions.  If  the  model 
is  to  be  quantitative,  subject  specialists  will  certainly  have 
to  be  consulted  to  weight  the  various  interacting  loops. 
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Case  Example 

Dynamic  Model  of  Water  Resources 

The  New  England  Water  Model  (NEWM). , as  presented  in  IWR  Paper 
72-3,  is  used  below  to  illustrate  dynamic  modeling  In  water  resource 
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planning.  The  generalized  procedure  £or  a dynamic  model  forecast 
consists  of  the  following  phases: 

• Formulate  the  problem--boundaries,  New  England 

• Identify  system  components--level  of  organization: 
highly  aggregate 

• Identify  feedback  loops--water  quality  and  availa- 
bility 

• Quantify  and  validate--not  illustrated 

• Simulate  future  values 

• Evaluate  output 

Formulate  the  Problem--In  constructing  a water  resource  model 
for  New  England,  the  important  problems  to  be  studied  are  the  ef- 
fects of: 

• Urban-rural  migration 

• Changes  in  the  economy  toward  services 

• Allocation  of  water  to  recreatidn 

• Pollution  control  policies. 

Because  this  was  an  exploratory  effort  designed  to  introduce 
the  concept  of  dynamic  modeling,  only  the  effect  on  pollution  con- 
trol policies  is  traced  to  an  output  stage.  More  specifically, 
the  focus  of  the  illustration  is  the  cost  effectiveness  of  alter- 
native investment  policies  in  meeting  a desired  water  quality  goal 
measured  in  tons  of  dissolved  oxygen. 

Identify  System  Components --The  model  is  first  disaggregated 
into  three  main  sectors:  capital,  population,  and  water. 
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The  capital  sector,  in  turn,  is  disaggregated  into  three 
subsectors:  industry,  services,  and  agriculture.  The  demands 

of  each  for  water  and  its  associated  pollution  burdens  are  fed 
into  the  water  sector.  Similarly,  the  capital  allocations  for 
water  quality  and  quantity  are  the  response  of  the  capital  sector 
to  the  water  sector.  Examination  of  this  feedback  loop  is  an  lm> 
portent  facet  of  our  study. 

The  population  sector  is  divided  into  rural  and  urban  subpop- 
ulations and  is  sensitive  to  both  intra-  and  interregional  migra- 
tion. Migration  is  taken  to  be  a function  only  of  employment. 

To  study  the  effect  of  other  causes  of  migration,  such  as  second 
homes,  retirement  homes,  and  so  on,  would  require  modification  of 
this  simplifying  assumption. 

The  water  sector  Includes  the  quantity  of  water  available, 
as  well  sb  the  pollution  burden,  both  in  dissolved  oxygen  and 
dissolved  salts.  In  this  sector,  the  effect  of  allocating  pollu- 
tion costs  differently  Is  examined,  as  well  as  the  effect  of  set- 
ting standards  for  water  quality.  The  development  of  new  tech- 
nologies .ind  their  impact  can  also  be  studied  in  this  sector. 

The  feedback  loop  diagram  for  system  components  is  shown  in  Fig- 
ure 18. 

Identify  Feedback  Loop  a --An  essential  part:  of  describing 
system  structure  1b  the  feedback  loop.  The  feedback  loop  traces 
qualitative  cause  and  effect  relationships  from  a given  variable 
buck  to  Itself.  There  are  two  types  of  loopa-'-positive  and  nega- 
tive. Positive  loops  amplify  while  negative  loops  attenuate  any 
change  in  the  By stem. 
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FIGURE  18  FEEDBACK  LOOP  DIAGRAM  FOR  THE  NEW  ENGLAND  WATER  MODEL 


Two  interlocking  feedback  loops  characterize  this  system,  as 
shown  in  Figure  19,  The  water  quality  loop  on  the  left  attempts 
to  raise  the  treatment  level  so  as  to  achieve  the  goal  of  a desired 


FIGURE  19  FEEDBACK  LOOP  DIAGRAM  FOR  WATER  QUALITY  AND  WATER 
AVAILABILITY 


dissolved  oxygen.  The  water  availability  loop  on  the  right  at- 
tempts to  develop  new  water  sources  to  meet  streamflow  demands 
of  industry  and  urban  municipalities. 

The  water  quality  loop  is  a negative  feedback  loop,*  as  any 
change  in  required  treatment  will  ultimately  result  In  a change 
in  the  opposite  direction  in  required  dissolved  oxygen  (DO).  Be- 
ginning with  required  DO  we  read:  required  DO  causes  an  increase 

in  required  investment,  which  increases  marginal  cost,  which  in- 
creases treatment  investment,  and  hence  increases  treatment  capi- 
tal. An  increase  in  treatment  capital  produces  more  effective 
treatment,  more  effective  treatment  reduces  the  biological  oxygen 
demand  (BOD)  rate,  a lesser  BOD  rate  increases  DO,  and  increased 
DO  reduces  required  DO. 

Quantify  and  Validate --The  qualitative  determinations  of 
feedback  loops  (Figures  18  and  19)  i ' in  themselves  valuable  exer- 
cises to  clarify  Interactions  among  several  variables.  In  order 
to  quantify  the  model,  specific  numerical  values  are  required  for 
the  parameters  in  the  system  structure.  This  requires  data  such 
as  were  extracted  from  the  North  Atlantic  Regional  Framework  Study 
for  the  New  England  Water  Model  and  the  use  of  experts  in  the  sub- 
ject matter,  Following  quantification,  the  experts  are  required 
to  verify  the  model. 

Simulate  Future  Values--Reference  to  the  DYNAMO  computer  pro- 
gram used  to  simulate  this  system  is  made  by  Brown  et  al.  (1974) 


Any  loop  that  contains  an  odd  number  of  inverse  relations  (-)  is 
considered  a negative  feedback  loop. 
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In  Models  and  Methods  Applicable  to  Corps  of  Engineers  Urban 
Studies,  U.S.  Army  Engineer  Experiment  Station,  Vicksburg,  Missis- 
sippi, The  actual  computer  program  is  available  for  $5  plus  post- 
age from  Jay  Martin  Anderson,  Department  of  Chemistry,  Bryn  Mawr 
College,  Bryn  Mawr,  Pa.  19010,  (A  note  of  caution:  the  program 

does  not  teach  system  dynamics  and  would  be  of  little  use  without 
a basic  understanding  of  system  simulation.) 


Evaluate  Output--As  an  example  of  the  output  derived  by  ap- 
plying this  technique,  the  effect  of  different  planning  horizons 
on  simulated  results  of  a plan  for  water  treatment  and  its  costs 
are  examined.  Two  cases  were  assumed:  a case  with  a short-range 

planning  horizon,  and  a case  with  a longer-range  horizon  for  which 
BOD  problems  are  anticipated.  Thus,  in  the  short-range  case,  BOD 
loads  are  anticipated  for  two  years  ahead;  while  for  the  longer- 
range  horizon,  BOD  loads  are  anticipated  for  10  years  into  the 
future.  In  each  case,  the  treatment  facility  is  planned  to  bring 
the  respective  BOD  loads  to  a fixed  standard.  Figure  20  shows  the 
two  simulations.  In  Simulation  B,  the  DO  level  easily  exceeds  the 
standard  for  desired  DO,  5 mg/L,  for  most  of  the  60-year  simula- 
tion; in  Simulation  A,  however,  the  standard  for  DO  is  never 
achieved. * A difference  between  the  costs  is  displayed,  with  the 
costs  of  Simulation  A rising  less  rapidly  because  fewer  future 
costs  are  internalized  in  the  present.  The  interrelatedness  among 
planning  horizon,  water  quality  standard,  and  cost  are  thus  modeled 
so  that  the  influence  of  changes  can  be  explicitly  examined.  The 


'This  is  primarily  a result  of  the  delay  in  bringing  treatment 
facilities  "on-line,"  which  is  represented  in  Figure  19  by  the 
element,  Treatment  Investment  Time. 
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1980  1980  2000  2020 


YEAR 

FIGURE  20  SIMULATION  OF  TREATMENT  AND  DEVELOPMENT 
COSTS  OF  WATER  IN  THE  UNITED  STATES  AND 
DISSOLVED  OXYGEN  FROM  I960  TO  2020 

optimum  planning  and  investment  coats  to  meet  the  desired  DO  level 
can  be  determined  by  running  simulations  between  A and  B. 

The  value  of  an  extended  planning  horizon  may  seem  obvious, 
but  a systems  dynamic  model  examining  water  quality  in  the  Ohio 
River*  indicated  that  water  treatment  facilities  were  constructed 
in  response  only  to  a delayed  perception,  much  less  a short-term 
projection  of  BOD  loads. 

J.  E.  Knight  and  W.  W.  Hines,  "Complex  Systems  Analysis  of  Water 
Quality  Dynamics:  The  Feedback  Systems  Structure,"  unpublished 

report  to  OWRR,  Georgia  Institute  of  Technology,  1970. 
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CROSS -IMPACT  ANALYSIS 


General  Description 

Abstract 

Cross-Impact  analysis  strives  to  Identify  Interactions  among 
events  or  developments  by  specifying  how  one  event  will  Influence 
the  likelihood,  timing,  and  mode  of  impact  of  another  event  in  a 
different  but  associated  field.  Cross-impact  analysis  is  used  not 
only  to  probe  primary  and  secondary  effects  of  a specified  event* 
but  to  improve  forecasts  and  to  generate  single  forecasts  (or  sce- 
narios) from  multiple  forecasts.  Cross -impact  analysis  is  a basic 
forecasting  tool  helpful,  if  not  essential,  in  most  sophisticated 
forecasting.  Every  forecaster  dealing  with  interacting  trends 
should  have  an  appreciation  of  the  principles  involved. 

Definition 

Cross-impact  analysis  is  a systematic  means  of  studying  the 
interactions  among  events  or  developments.  The  analysis  evaluates 
changes  in  likelihood  of  occurrence  among  an  entire  set  of  possible 
future  events  in  light  of  limited  changes  in  probability  for  some 
of  the  events  in  that  set  (Enzer,  Boucher,  Lazar,  1971).  Thus, 
in  ualng  cross-impact  analysis,  experts  strive  to  identify  the 
few  most  important  chains  of  events  from  among  the  many  possible 
chains. 


Aa sumptions 

The  underlying  assumption  is  that  a change  in  technology, 
soalal  practices,  values,  or  any  other  area  will  affect  the  sur- 
rounding environment  in  three  ways.  It  wills 

• Change  the  probability  of  occurrence  of  interconnected 
events. 

» Change  the  timing  of  interconnected  eventB. 

• Affect  the  mode  of  impact  of  interconnected  events. 

The  analysis  is  based  on  the  ability  of  subject  specialists  to 
derive  subjective  estimates  of  the  probability  of  occurrence  of 
future  developments  in  a given  time  period. 

History 

The  cross-impact  method  had  its  origin  in  "future, " a simple 
simulation  game  Invented  by  Theodore  Gordon  and  Olaf  Helmer  in  the 
mid-1960s  (Gordon,  Hayward,  196S).  By  1968,  a computer-based  ap- 
proach had  been  designed  to  consider  explicitly  the  interconnec- 
tions among  events.  The  method  has  found  widespread  use  in  tech- 
nological as  well  as  social  forecasting.  Perhaps  the  most  advanced 
cross-impact  analyses  have  been  carried  out  by  such  groups  as  the 
Institute  for  the  Future,  Monsanto,  and  The  Futures  Group.  Appli- 
cations include!  Minuteman  missile  deployment,  alternative  future 
environments  for  education,  long-range  corporate  planning,  technol- 
ogy assessments  of  electric  automobiles,  and  many  more. 
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Main  Uses 


l 


The  main  use  of  the  method  is  to  describe  and  quantify  the 
impact  of  one  development  upon  otherB.  Most  frequently  the  tech- 
nique is  used  to  "identify"  which  events  are  likely  to  be  most 
important  to  some  aspect  of  the  future  and  how  these  events  are 
likely  to  Interact.  Cross-impact  analysis  is  often  used  to  com- 
pare the  implications  of  differing  forecasts  in  a given  field  and 
to  combine  separate  forecasts  in  discrete  but  allied  fields  Into 
a single  forecast. 

Results  have  been  used  to  define  primary  and  secondary  ef- 
fects of  a change  (or  a forecasted  change)  in  one  area  upon: 
social  trends,  new  or  altered  social  demands,  institutional  func- 
tions (such  as,  personnel,  production,  distribution),  developments  , 
in  urban  services,  highways,  recreation  areas,  management  policies, 
R&D  decisions,  and  similar  areas.  The  technique  provides  insight 
into  trade-off  options  and  is  useful  in  testing  the  consequences 
of  various  policy  actions.  By  clarifying  the  critical  events 
underlying  possible  future  developments,  the  method  helps  to  iden- 
tify the  contingencies  of  future  proposed  programs.  Computerized 
runs  of  cross-impact  matrices  establish  better  estimates  of  the 
probability  of  occurrence  of  individual  events,  facilitate  tests 
of  the  most  effective  responses  under  various  circumstances,  ar! 
point  to  the  key  events  to  be  monitored. 


Limits  and  Cautions 

Cross-impact  analyses  cannot  allow  for  events  not  included 
in  the  matrix.  Therefore,  defective  or  inadequate  models  of 
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Interacting  elements  can  yield  misleading  resultB.  Two  other 
problems  are  evident.  First,  assignment  of  probabilities  of  in- 
teractions are  subject  to  much  uncertainty,  especially  in  areas 
whose  origin  and  anatomy  are  not  clear.  Examples  include  such 
"soft"  trends  as  alienation,  changing  priorities  and  values, 
political  disruption,  or  crime.  Second,  it  is  important  to  bear 
in  mind  that  results  are  probabilistic,  not  certain  occurrences. 
Indeed,  high-probability  events  in  the  real  world  occasionally 
fail  to  occur  and  low-probability  events  will  occasionally  occur. 

Other  Techniques 

Intuitively,  participants  in  brainstorming,  scenario  writing, 
pattern  recognition,  and  Delphi  forecasting  make  use  of  crosB- 
impact  analysis,  although  not  necessarily  in  a focused  or  system- 
atic fashion.  The  technique  is  used  as  paft  of  such  forecasting 
methods  as  feedback  analysis,  decision  analysis,  and  relevance 
trees.  It  is  a central  element  in  interactive  simulation  tech- 
niques of  forecasting,  such  as  Forrester-type  dynamic  models  or 
KSIM.  Trend  impact  analysis  is  a further  development  in  impact 
analysis  and  is  particularly  useful  in  coupling  existing  trends 
with  a range  of  possible  future  scenarios  (Gordon,  Becker,  Gerjuoy, 
undated).  Corps  planners  may  associate  this  technique  with  Impact 
assessment. 
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Product  or  Result 


The  main  output  is  a table  or  aeries  of  tables  showing  Inter- 
actions among  Items.  Major  studies  may  Include  numerous  computer 
runs  showing  one-to-one  Interactions  using  a variety  of  assumptions; 
Interactions  among  events,  or  among  subdivided  events.  Very  often 
interactions  identified  on  a matrix  are  strung  together  on  a time 
basis  to  create  a scenario. 

Level  of  Detail 

Results  can  be  detailed  or  gross,  depending  upon  the  subject 
being  forecast  and  the  elements  taken  into  account  in  the  cross- 
impact  matrix. 

Level  of  Confidence 

For  the  most  part,  results  from  cross-impact  analyses  tend 
to  be  speculative.  The  reason  is  that  the  technique  is  selected 
chiefly  in  areas  where  interrelationships  are  unclear.  Simple 
circumstances,  such  as  the  impact  of  births  in  one  year  on  popu- 
lation levels  a decade  later,  are  seldom  subjected  to  formal' c^roso- 
impact  analysis. 

Communicability  of  Results 

Circumstances  vary,  but  in  general  the  communicability  of 
cross -impact  analysis  is  good.  The  basic  concept  of  interrelating 
consequences  in  matrix  form  la  easily  graBped.  Time -sequencing 
into  scenarios  further  enhances  communications. 

126 


Credibility  of  Results 


Credibility  of  results  ranges  from  high  to  doubtful,  depend- 
ing on  the  subject  matter.  Many  scenarios  based  on  cross-impact 
analysis  are  intended  less  to  be  "credible"  than  to  illustrate 
the  consequences  of  given  events.  It  seems  to  be  a law  of  human 
nature  that  outcomes  that  we  consider  desirable  are  more  credible 
than  unde  sired  outcomes. 

Span  of  Forecasts 

Forecasts  can  be  of  any  duration,  although,  as  In  most  fore- 
casting methods,  credibility  tends  to  decline  with  length  of  span. 

Resources  Needed 

The  most  crucial  resource  is  imaginative  people  knowledgeable 
in  the  field  being  analyzed.  This  is  a difficult  combination  to 
find  in  many  areas  of  engineering  and  science.  The  kind  of  prob- 
lem selected  for  cross-impact  analysis  usually  benefits  most  from 
imaginative  thinking,  whatever  the  person's  level  of  expertise  in 
the  subject  matter,  Some  of  the  more  systematic  creativity  tech- 
niques, Buch  as  synectics,  argument  by  analogy,  or  brainstorming, 
are  sometimes  helpful  in  performing  cross-impact  analysis. 

To  complete  a cross-impact  matrix  is  difficult  and  taxing 
work.  Computerized  assistance  is  essential  if  complex  simultaneous 
interaction  must  be  evaluated  or  if  the  consequences  of  alternative 
trends  and  options  are  to  be  explored.  Requirements  of  time  and 
money  for  a complete  cross-impact  analysis  depend  wholly  on  the 
nature  of  the  problem.  Estimates  range  between  $5,000  and  $50,000. 
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An  existing  cross-impact  computer  program  is  available  from 
The  Futures  Group,  Glastonbury,  Connecticut.  The  cost  of  the  pro- 
gram, documentation,  and  one  day  of  instruction  is  approximately 
$2,000.  The  cost  of  actually  running  the  program  is  minimal — 

$2  to  $5  per  run. 

Procedures 

The  skills  involved  in  performing  cross-impact  analyses  range 
from  elementary  to  beyond  the  skills  of  anyone.  Most  planners 
will  need  help  from  subject  specialists  if  any  of  the  events  being 
evaluated  are  complex  (e.g. , Institutions,  attitude',  technology). 
Since,  as  remarked  .earlier,  the  technique  is  usually  applied  to 
nonobvious  relationships,  this  means  that  most  cross-impact  analy- 
ses require  a team  of  specialists  working  under  the  direction  of 
the  planner. 

Case  Example 

CroBs-lmpact  Analysis  of  Demographic  Factors 

In  the  following  discussion,  a generalized  cross-impact  pro- 
cedure is  used  to  evaluate  the  probable  effect;,  of  lower  population 
and  related  factors  on  the  Corps  civil  work  mission.  There  are 
six  main  tasks: 

• Identify  issues 

* Identify  events  that  affect  the  issues 

* Construct  cross-impact  matrix 

• Calculate  new  probabilities 


♦ Use  the  matrix  to  answer  questions 

• Evaluate  results. 

Identify  Issues-^Flood  control,  navigation,  water  Bupply, 
beach  erosion  control,  hydropower,  recreation,  and  water  quality 
have  been  identified  as  seven  major  issues  in  the  Corps  mission. 
Work  in  the  areas  of  recreation,  water  supply,  and  water  quality 
Beem3  to  be  increasing  while  activity  in  the  area  of  hydropower 
has  been  substantially  reduced.  Flood  control,  navigation,  and 
beach  erosion  projects  have  remained  fairly  constant  over  the 
past  decade. 

Identify  Events- -On  December  17,  1972,  the  Census  Bureau 
Issued  new  population  projections  for  the  United  States  for  the 
year  2000.  These  were  drastically  lower  than  previous  projections. 
The  essence  of  the  changes  are  shown  in  Figure  21, 

The  new  projections  indicate  that  the  total  population  of 
the  United  States  may  increase  by  only  20  percent  by  the  year  2000 
instead  of  the  50  percent  anticipated  by  earlier  projections.  How- 
ever, even  Series  f*  projections  still  show  a net  increase  of  42 
million  people,  and  the  water  resource  development  needs  of  these 
people  may  b«  different  from  those  for  a larger  population. 

Regardless  of  which  population  projection  is  eventually  used 
for  planning,  the  effect  on  near-term  (19801  wator  needs  is  minimal, 
The  projected  rate  of  household  formation  through  the  trid-1980s  is 


US.  Department  of  Commerce,  Projections  of  the  Population  of  the 
United  States,  1970  to  2020,  P-25,  No.  493,  GPO. 
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Report  of  the  President  a Commission  on  Population  Growth  and  the 
American  Future. 


PRESENT  POPULATION 
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FIGURE  21  CHANGES  IN  POPULATION  PROJECTIONS  FOR  THE  YEAR  2000 
(Published  In  the  New  York  Tlmtt,  December  18,  1872). 


on  the  order  of  1.2  to  1.5  million  per  year  as  compared  to  a 1960s 
average  of  1.0  million  per  year.  The  pressure  for  resource  devel- 
opment during  this  time  span  is  "locked  in"  by  the  ago  distribution 
of  the  existing  population. 

The  President's  Commission  Report*  assumes  a doubling  of  GNP 
regardless  of  the  rote  of  population  growth.  This  assumption  is 
accepted  herein,  with  reservations  about  the  conclusion.  The  rate 


of  growth  of  GNP  should  be  sensitive  to  a number  of  interrelated 
variables  that  are  in  turn  keyed  into  population  growth  (such  as 
population  — water  quality  — *»  investment  in  pollution  con- 
trol — *•  GNP)  and  alternative  GNPs  may  be  more  important  than 
alternative  population  levels  as  far  as  water  needs  are  concerned. 

Other  interrelated  trends  could  result  in  mutually  supportive 
or  mutually  cancelling  effects.  Increased  per  capita  income  (with 
more  discretionary  income)  plus  shorter  work  weeks  could  result 
in  a significant  Increase  in  recreation  demand  that  could  more 
than  counterbalance  decreased  demand  from  a smaLler  and  older 
total  population.  These  relationships  are  not  clear  enough  at 
the  present  time  to  draw  firm  conclusions,  but  these  chains  of 
effects  could  be  critical  to  Corps  programs. 

The  most  important  effect  may  center  on  the  distribution  of 
future  populations,  not  on  the  size  of  the  population  itself.  A 
continued  concentration  of  population  in  coastal  regions  and  out- 
migration from  the  interior  may  intensify  water-related  problems 
in  some  regions  and  reduce  them  in  others. 

If  only  lower  population  projection  is  considered  in  relation 
to  Corps  missions,  the  effects  on  current  levels  or  expectations 
could  be  assessed  as  generally  negative,  as  shown  in  the  tabula- 
tion on  the  following  page. 

However,  many  economic  and  demographic  factors  associated 
with  population  growth  are  both  interrelated  and  interactive. 

These  include:  aging,  population,  GNP  growth  rate,  per  capita 

income,  leisure  time,  urbanization,  and  increased  household  for- 
mation,, 
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Mission 

Flood  control 

Navigation 

Water  supply 

Beach  erosion  control 

Hydropower 

Recreation 

Water  quality 


Effects 

Lower  Population 
Growth  Rate 

Less 

No  effect 
Less  ' 

Less 

No  effect 

Leas 

Less 


Table  IS  expands  on  the  foregoing  chart  and  displays  an 
assessment  of  the  relative  Importance  of  selected  economic  and 
social  Indicators  on  many  of  the  Corps  missions.  Again,  the  eval- 
uations shown  are  with  respect  to  current  levels  or  expectations. 

Construct  Cross-Impact  Matrlx--A  cross-impact  matrix  can  be 
completed  for  the  most  important  events  assessed  in  the  effects 
chart  in  order  to  provide  insights  into  the  interactions  of  those 
events  upon  each  other.  Thus,  for  purposes  of  illustration,  the 

I JU 

following  events  have  been  selected  as  the  most  important  and 
assigned  initial  probabilities  as  follows: 


Event 

Name 

Lower  population  growth  rate 
More  leisure 
More  urbanisation 
More  household  formation 


Probability  of 
Occurrence  by  1980 
(initial  probabilities) 


Therr  is,  of  course,  no  ban  to  using  any  number  of  factors  except 
the  increased  complexity  of  the  procedure. 
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The  assignment  of  probabilities  should  engage  the  most  knowl- 
edgeable people  available.  The  cross-impact  interaction  values 
are  obtained  by  using  a panel  of  experts,  or  Inputs  from  a Delphi. 
In  an  intraoffice  situation,  a mini-Delphi  survey  would  be  useful 
for  quick  approximation. 

The  cross-impact  matrix  is  set  up  by  listing  the  events  as 
row  and  column  headings  of  a table.  The  initial  probabilities 
of  occurrence  are  shown  in  parentheses  beside  the  events.  Par- 
ticipants are  then  asked  to  estimate  conditional  probabilities, 
assuming  each  event  in  turn  were  to  occur.  Thus,  the  numbers  in 
the  matrix  are  referred  to  as  conditional  probabilities.  The  com- 
pleted cross-impact  matrix  with  estimates  of  conditional  probabil- 
ities is  illustrated  in  Table  16. 


Calculate  New  Probabllltles--With  no  frequency  information, 
a nonoccurrence  matrix  1b  calculated  using  standard  statistical 
definitions.*  To  illustrate  the  analysis  of  such  a matrix,  we 
can  follow  Theodore  Gordon's  computer  process  step  by  step. 

• From  among  the  events,  one  is  selected  at  random,  say 
Event  3. 

• A random  number  (from  0 to  1)  is  generated  by  the 
computer  and  compared  with  the  initial  probability 


P(R/C ')  =>  [P(R)  - P(C/R)  • P(C)]  / [1  - P(C)] 


where  R represents  a row 

C represents  a column 
P(R/C)  represents  en- 
tries in  the  matrix 


P(C)  represents  initial  proba- 
bilities 

P(R/C')  probability  of  R given 
C does  not  occur 
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Table  16 

OCCURRENCE  MATRIX 


If  this 
event  were 
to  occur 


...then  the  "new"  probability  of  occurrence 

1 of  these  events  would 

se: 

Lower 

More 

More 

More 

Population 

Leisure 

Urban 

Household 

1.  Lower 

population 

(0.8) 


2.  More 
Leisure 
(0.9) 


3.  More 
urban 
(0.7) 


4.  More 

household 

(0.6) 


Values  in  parentheses  ( ) are  the  initial  probabilities 

Values  in  the  matrix  are  referred  to  as  conditional 
probabilities. 


of  Event  3,  Say  the  selected  number  Is  0.6.  Since 
the  Initial  probability  of  Event  3 is  greater  than 
the  selected  number,  the  event  is  recorded  as  having 
occurred.  (That  is,  for  the  first  pasB  the  value  for 
Event  3 is  recorded  aa  100  percent.) 

• The  initial  probabilities  of  the  remaining  events  are 
adjusted*  as  indicated  by  the  conditional  probabilities 
in  the  occurrence  matrix.  Thus,  population  stays  the 
same--0.8;  leisure  stays  the  same--0.9}  and  households 
increase  to  0.7.  Note,  if  the  event  Is  recorded  as 
not  having  occurred,  the  probabilities  of  the  remain- 
lng  events  are  adjusted  as  indicated  in  the  nonoccur- 
rence matrix.  (The  nonoccurrence  matrix,  calculated 
from  the  occurrence  matrix,  is  not  illustrated  in  this 
example.) 

• A Becond  event  is  selected  at  random  from  these  remain- 
ing events,  say  Event  4 (excluding  Event  3 since,  for 
this  sequence,  its  occurrence  has  already  been  decided). 

• The  procedure  described  in  Step  2 is  repeated.  Thus, 
Event  4 is  decided  on  the  basis  of  itu  new  probability. 
(Note,  the  nev  probability  for  Event  4 is  now  0.7.) 

• Now,  the  probabilities  of  the  remaining  events  are 
computed  depending  upon  whether  Event  4 "occurred"  or 
"did  not  occur." 

• The  occurrence  or  nonoccurrence  of  the  events  are  de- 
cided in  this  manner.  At  the  end  of  the  sequence  a 
"happen"  or  "didn't  happen"  notation  is  associated 
with  each  event.  For  example,  Events  2,  3,  and  4 are 
recorded  as  "happened,"  while  Event  1 is  recorded  as 
"didn't  happen." 


For  a more  detailed  discussion  of  the  mathematical  adjustment 
see  John  Stover,  "Suggested  Improvements  to  the  Dciphi/Cross- 
Impact  Technique,"  Futures,  Vol.  5,  No,  3,  pp.  308-313  (June 
1973). 
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• The  process  is  repeated  many  times,  typically  1000, 
to  arrive  at  a final  probability  estimate:  this 

represents  a new  scenario.  Final  probability  esti- 
mates are  computed  for  each  event  based  on  the  num- 
ber of  times  each  appeared  during  the  process.  For 
example,  if  Event  1 was  recorded  as  having  occurred 
500  out  of  the  1000  times,  its  final  probability 
estimate  in  the  new  scenario  would  be  0.5. 

Use  the  Matrix  to  Answer  flueatlona- -Following  the  computer 
run,  the  initial  and  final  probabilities  are  adjusted  to  coincide 
and  the  matrix  can  then  be  used  to  answer  questions  or  test  poli- 
cies in  the  form  of  "what  if"  questions. 

For  example,  what  if  the  federal  government  were  to  pursue 
a policy  of  forceful  subsidization  of  new  house  construction, 
such  as  the  $2,000  tax  credit  recently  adopted?  What  would  the 
effect  be  on  the  other  factors  being  considered? 

Evaluate  Results--By  raising  the  probability  of  more  house- 
hold formation  to  100  percent  (this  1b  to  Bay  that  the  event  oc- 
curred) the  computer  would  produce  results  such  as  the  following 
(this  is  not  a computation  and  is  only  Intended  for  Illustrative 
purposes) . 


No. 


Name 


Probability  of  Occurrence 

by  1980 

Household 
Formation  at 
Initial  100  Percent 


Lower  population  growth  rate 
More  leisure 
More  urbanization 
More  household  formation 
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A similar  analysis  can  be  made  with  respect  to  each  o£  the 
other  factors. 

In  order  to  arrive  at  an  overall  assessment  of  future  changes 
in  Corps  missions,  results  from  the  Impact  matrix  can  be  compared 
with  the  effects  of  a single  population  event,  as  in  Table  17. 

Table  17 

IMPACTS  ON  CORPS  MISSION  FROM 
OCCURRENCE  OF  LOWER  POPULATION  RATES 


Corps  Mission 


Flood  control 

Navigation 

Water  supply 

Beach  erosion  control 

Hydropower 

Recreation 

Water  quality 


In  Isolation 

Less 

No  affect 
Leas  ■ 

Less 

No  effect 
Less 

Less 


With 

Interacting 

Events 


More 

Much  more 
Much!  much  more 
No  effect 
Much,  much  more 
Much,  much  more 


The  conclusion  implied  by  the  above  is  that  a lower  popula- 
tion growth  rate,  when  examined  in  the  light  of  other  interacting 
events,  would  create  a somewhat  different  set  of  water  resource 
needs,  and  generally  in  the  direction  of  Increases  in  the  Corps 
missions,  with  particular  emphasis  on  beach  erosion  control,  rec- 
reation, and  wator  quality.  Additionally,  it  might  be  concluded 
that  the  Corps  mission  is  more  sensitive  to  population  shifts 
(concentration  or  diapersion)  than  to  population  growth  itself. 
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KSIM 


General  Description 


Abstract 

KSIM  Is  a cross-impact  simulation  technique  used  to  better 
forecast  and  assess  long-range  requirements  and  impacts  of  water 
resource  development  alternatives.  The  technique  provides  a tool  \\- 

i > 

to  interface  broad  planning  issues  with  detailed  dynamic  models 
so  that  more  effective  use  can  be  made  of  planning  resources. 

Both  qualitative  and  quantitative  data  can  be  used--a  unique 
characteristic.  KSIM  combines  a small  group  workshop  procedure  ‘ 
with  a mathematical  forecasting  model  and  a computer  program  to 

i • 

generate  changes  over  time  in  a few  significant  planning  variables. 
The  method  helps  to  Identify  planning  needs,  develop  models,  and 
test  the  consequences  of  policy  actions.  The  technique  requires 
expert  leadership  and  access  to  a computer.  A KSIM  computer  pro- 
gram is  available. 


Definition 

KSIM  presents  a mathematical  means  of  articulating  and  visu- 
alizing what  people  sense  to  be  the  relationships  among  a number 
of  Interacting  variables.  As  a simulation  tool,  it  combines  ex- 
pert opinions  with  analytical  computing  techniques  to  analyze  re- 
lationships among  broadly  defined  variables  in  environmental  and 
socioeconomic  systems.  The  technique  enables  a team  of  people, 
first,  to  define  and  structure  a set  of  variables  describing  a 
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perceived  problem  and  then,  using  an  interactive  computer  program, 
to  calculate  and  display  the  changes  in  the  variables  over  time. 

By  observing  the  changes  and  then  making  modifications  and  refine- 
ments, the  team  develops  a model  of  the  problem  situation.  With 
the  model,  Individuals  can  test  various  alternatives  and  review 
and  improve  their  understanding  of  the  problem.  Like  all  simula- 
tions, KSIM  seeks  to  establish  "if-then"  relationships;  however, 
KSIM  has  the  distinctive  feature  of  accommodating  subjective  or 
intuitive  concepts  as  well  as  quantitative  data. 


Assumptions 

KSIM  shares  with  other  model  and  simulation  techniques  the 
general  assumptions  that  a satisfactory  model  can  indeed  be  de- 
vised and  that  the  relationships  among  parts  can  be  defined,  at 
least  qualitatively.  Specific  to  the  KSIM  procedure  are  the  as- 
sumptions that  realistic  bounds  on  ail  system  variables  can.be 
set  and  that  S-shaped  curves  are  adequate  to  describe  change  pat- 
terns in  human  affairs. 


Hi b tory 

KSIM  was  developed  in  the  early  1970s  by  Dr.  Julius  Kane  on 
the  premise  that  "it  is  the  'soft  data1 --value  judgments,  opinions, 
cherished  notions--that  control  the  dynamics  of  the  politics  ma- 
chine. If  computers  are  to  be  effective  instruments  of  policy, 
then  they  must  have  open  channels  that  can  accept  subjective  data 
and  give  it  its  proper  role."  Although  the  technique  is  quite  new, 
there  have  been  a number  of  applications.  These  include; 
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• Water  resource  planning- -Corps  of  Engineers. 

• Impact  assessment  workshops--Institute  for  Water 
Resources. 

• New  ventures  or  prcducts--Pilkington  Brothers  Ltd., 
England. 

• Environmental  planning--Departments  of  Environment 
and  Industrial  Trade,  Canada. 

• Educational  tool  for  systems  analysis--University 
of  British  Columbia,  Portland  State  University. 

Main  Uses 

KSIM  is  useful  for  problem  formulation,  "needs"  identifica- 
tion, and  communication.  It  allows  planners  to  understand  system 
structure,  relate  quantitative  and  qualitative  factors,  and  di- 
rectly communicate  their  perceived  outcome  of  proposed  planning  . 
interventions,  Corps  planners  can  use  KSIM  to  study  the  impli- 
cations of  changes  that  resul^ltom  the  interaction  of  system 
variables  or  from  implementation  of  alternative  policies  of  water 
resource  planning.  It  can  also  be  an  effective  procedure  for 
incorporating  community  or  expert  opinion  into  water  resource 

i 

planning.  V ' 

Limits  and  Cautions 

The  simulation  does  not  tell  planners  what  alternative  solu- 
tion to  choose.  Rather,  it  is  an  information  and  display  device 
by  which  major  issues,  needs,  and  concerns  emerge.  The  procedure 
is  designed  to  handle  broad  variables  and  to  be  applicable  only 
in  the  early  stages  of  Corps  planning.  Special  caution  must  be 
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exercised  in  translating  human  intuition  into  mathematical  terms. 

In  using  KSIM,  as  well  as  other  techniques  based  on  feedback,  it 
is  necessary  to  keep  alert  to  the  possibility  of  a variable  evolv- 
ing beyond  some  reasonable  limit. 

Other  Techniques 

KSIM  is  a blend  of  many  techniques.  Therefore,  depending 
on  the  situation,  planners  may  usefully  use  brainstorming,  author- 
ity forecasting,  panels,  or  Delphi  for  collecting  expert  opinions; 
cross-impact  analysis  or  input-output  analysis  for  assessing  inter- 
actions; dynamic  modeling  for  simulation;  and  alternative  futures 
or  scenarios  for  assessing  the  outcome  of  projects  under  various 
conditions. 

Product  or  Result 

Ideally,  the  initial  product  of  a KSIM  simulation  is  a work- 
ing model  of  the  problem.  The  model  is  used  to  test  planning  op- 
tions by  exploring  how  a range  of  likely  futures  may  affect  a given 
plan  or  by  examining  how  various  changes,  such  as  in  public  prefer- 
ences, vould  alter  outcomes  of  plans.  The  output  appears  either 
as  columns  of  numerical  forecasts  or  as  graphics  illustrating  the 
changes  of  significant  variables  over  time.  However,  in  KSIM  ses- 
sions it  is  often  the  process  (exchange  of  views,  surfacing  of 
ibsues,  identification  of  coucerns,  and  so  on)  that  is  more  Im- 
portant than  the  product. 
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Level  of  Detail 


KS1M  deals  with  aggregate  variables  (up  to  12  In  number) 
ond  structural  relationships  and  does  not  give  precise  numerical 
answers.  Output  values  for  all  variables  range  between  ero  and 
one. 

Level  of^Confldencc 

Ti;«  model  reflects  the  experience  and  judgments  of  the  team 
members.  While  the  results  may  be  limited  by  the  availability  of 
"hard  data."  the  confidence  in  results  is  usually  governed  by  the 
level  of  confidence  placed  in  the  participants. 

Communicability  of  Results 

Results  from  a K'SXM  exercise  ere  generally  straightforward 
end  easy  to  communicate.  The  crous-impact  matrix  clearly  illus- 
trates the  relationships  among  variables.  Outputs  for  various 
alternatives  cun  be  readily  displayed  and  compared. 

Credibility  of  Results 

When  presented  as  the  team's  perception  of  the  existing  situ 
ation  and  of  changes  due  to  planning,  the  results  are  generally 
accepted.  However,  the  KSIM  technique  is  fairly  new  and  has  not 
undergone  extensive  testing.  Thus,  its  credibility  as  a forecast 
ing  technique  is  yet  to  be  established. 


Span  of  Forecasts 

The  procedure  is  designed  to  accommodate  both  short-  and  . 
long-term  relationships.  However,  since  the  concepts  usually 
Involve  broad  first-state  planning  objectives,  long-term  (30  to 
50  years)  forecasts  are  the  most  common. 

Resources  Needed 

Required  resources  include  a leader,  participants,  and  access 
to  a computer.  An  experienced  coordinator  is  required  to  lead  a 
formal  KSIM  workshop.  Hence,  while  a workshop  providing  solutions 
to  a given  problem  can  be  completed  in  less  than  a week,  there  is 
a requirement  either  to  hire  a leader  or  learn  the  procedure.  It 
is  estimated  that  learning  the  subtleties  of  KSIM  could  take  any- 
where from  a few  daya  to  a month  or  more,  depending  upon  the  back- 
ground of  the  potential  leader.  Participants  should  be  experts 
in  their  designated  fields,  but  need  no  experience  in  mathematics, 
modeling,  or  systoms  analysis.  The  KSIM  computer  program  is  avail- 
able on-line  or  batch  via  IWR  or  the  Waterways  Experiment  Station 
at  Vicksburg.  A workshop  may  cost  several  thousand  dollars  or 
more,  although  each  computer  run  for  a specific  case  costs  only 
a dollar  or  two. 


Procedures 

Most  planners  will  need  guidance  on  procedures  in  conducting 
their  first  KSIM  forecasts.  Depending  on  the  topic,  specialists 
on  the  subject  matter  will  also  be  required.  Even  so,  KSIM  is 
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essentially  a fairly  simple,  straightforward  method  that  can  be 
mastered  with  a little  experience. 


Case  Example 

KS1M  Simulation  of  Impacts  of  Deep  Water  Porta 

The  KSIM  crcss»lmpact  simulation  la  used  below  to  assess 
some  of  tihf  broad,  lbng-ter'm' Impacts  of  U.$.  deep  watar  porta 
(DWP) . Steps  for  a small  gtl'itiy  KSIM  workshop  Include: 

1 1 ' I 

• Preliminaries— relact  the  group  and  the  setting 

■ Formulate  the  problem 

• Identify  the  significant  variables 

• Dovoiop  a cross -Impact,  matrix 

• Refine  the  model 

• Examine  alternatives 

• Draw  conclusions. 

Preliminaries- -KSIM  workshops  are  best  conducted  at  locations 
free  from  distractions  and  interruptions.  There  should  be  a com- 
puter terminal  available  and  access  to  a telephone  line  (for  the 
computer) . 

Next,  a team  of  people  knowledgeable  about  the  subject  but 
with  diverse  oackgrounds  and  Interests  should  be  selected.  The 
ideal  team  size  varies  from  five  to  eight,  including  experto  and 
team  coordinators. 

Formulate  the  Problem—The  workshop  problem  wee  to  assess 
the  impacts  of  DWP  for  oil  Imports. 
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During  the  problem  formulation  session,  the  team  identified 
numerous  local,  regional,  national,  and  possible  global  impacts 
from  DWP.  However,  to  limit  thh  scope  of  t’.e  problem  for  the 
workshop  exercise,  the  team  chose  to  consider  only  the  national 
implications  of ,a  U.S.  DWP  policy.  The  basic  assumptions  were: 

• There  Is  an  energy  shortage 

• DWP  are  needed  to  overcome  the  shortage 

• Imports  are  available  via  ocean  shipping. 

The  alternatives  to  be  teated  during  the  workshop  Included: 

• What  if  crude  oil  imports  were  cut  off? 

• What  if  the  United  States  implemented  a policy  to 
develop  DWP? 

• What  if  DWP  are  developed  and  then  foreign  imports 
are  cut  off? 

• What  if  DWP  wore  developed  with  a celling  on  energy 
use? 

Identify  the  Significant  Variables.- -The  KSIM  panel  structured 
a national  DWP  system  using  five  aggregate  variables:  energy  use, 

domestic  energy  supply,  domestic  investment,  reliance  on  tradi- 
tional sources,  and  public  confidence  (see  Figure  22). 

All  variables  in  the  system  were  defined,  labeled,  end  seeled 
to  range  from  a minimum  value  of  zero  to  a maximum  value  of  one. 
Initial  values  were  estimated  within  the  zero-to-ona  range, 

Energy  Use  refers  to  the  nation's  energy  demands.  Im- 
plicit in  the  first  assumption  is  the  policy  to  meet  the  projected 
4 percent  per  annum  growth  in  energy  demand.  The  maximum  was 
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PUBLIC 

CONFIDENCE 


estimated  at  four  times  present  use.  Zero  energy  used  was  set 
aa  the  minimum.  The  initial  value  for  energy  use  was  estimated 
at  25  percent  of  maximum  possible  use. 

Domestic  Energy  Supply  is  a direct  measure  of  the  U.S. 
energy  import  situation.  A value  of  one  means  that  the  United 
States  is  totally  self-sufficient.  Zero  Indicates  that  all  U.S, 
energy  is  imported.  It  was  hypothesized  that  people  would  feel 
threatened  by  increasing  dependence  on  foreign  energy  sources. 
Considerations  include  a monetary  crisis  and  possible  foreign 
conflicts.  Currently,  the  United  States  imports  only  10  percent 
of  its  energy;  thus  the  initial  value  for  domestic  energy  supply 
was  set  at  0.9. 

Domestic  Investment  was  used  to  indicate  the  national 
incentive  to  invest  in  new  energy  reserves  and  sources.  This 
includes  both  economic  and  social  incentives  for  new  exploration, 
and  research  and  development  of  alternative  Bourcos,  such  as 
solar,  geothermal,  breeder  reactors,  and  fusion  power.  A maximum 
domestic  Investment  was  perceived  to  be  10  percent  of  GNP,  with  a 
minimum  being  no  investment.  The  present  domestic  investment  was 
assessed  at  0.05. 

Reliance  on  Traditional  Sources  or  Energy  Alternatives 
la  *n  index  of  U.S.  flexibility  with  respect  to  energy.  The  energy 
alternatives  refer  to  the  physical  parameters  of  time,  technology, 
and  money,  as  well  as  the  social  alternatives,  such  aa  conservation, 
attitude,  and  institutional  organisations.  Figure  23  illustrates 
the  transition  from  traditional  energy  sources  to  new  technologies 
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FIGURE  23  U.S.  DEPENDENCE  ON  ENERGY  SOURCES 


over  time.  At  present,  we  depend  on  the  traditional  sources  of 
coal  and  oil  for  90  percent  of  our  energy. 

Public  Confidence  wa*  used  to  register  both  short-term 
fluctuations  in  public  satisfaction  and  the  long-term  trust  of 
the  American  people  in  their  government.  The  long-term  trend 
was  perceived  as  fairly  constant  with  a slight  decline.  The 
upper  limit  of  one  referred  to  complete  trust,  while  the  zero 
value  indicated  "not  satisfied."  The  long-term  lack  of  satisfac- 
tion is  expressed  not  through  revolution  but  rather  through  apathy. 
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Outside  World.  An  exogenous  variable  labeled  "outside 

I 

world"  was  also  used  to  indicate  the  Interactions  among  the  na- 
tional system  and  subsequent  local)  regional,  and  global  systems. 

Develop  a Cross-Impact  Matrlx--Tha  cross-impact  matrix  shown 
in  Table  18  provides  the  structure  for  the  system.  To  complete 
the  matrix,  the  team  determined: 

• If  there  was  a relationship  between  two  variables. 

If  the  answer  was  no,  they  entered  zero  in  the  matrix. 

If  the  answer  was  yes,  they  proceeded  to  the  next 
question. 

• If  the  relationship  was  positive  or  negative. 

• The  strength  of  the  relationship.  In  this  example 
a range  of  +3  to  -3  was  used. 


What  is  the 
relationship 
between  this 
variable 


Energy  use  A 

Domestic  »l. 

energy  supply 

Domestic  2, 

investment 

Energy  C 

alternatives 

Public  0. 

confidence 


Table  18 

DWP  CROSS -IMPACT  MATRIX 

. , . and  theae  variables? 


EU 

(0.25) 

DES 

(0.9) 

DI 

(0.05) 

EA 

(0.9) 

PC 

(0.8) 

Outside 

World 

A 

-1.0 

1.4 

B 

2.2 

-1.2 

1,4 

2.0 

1.6 

0 

2.0 

-1.8 

1.0 

2.0 

1.0 

1.8  -2.8 
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Entries  on  the  table  represent  the  impact  of  the  column 
variable  on  the  raw  variable.  Numbers  in  parentheses  indicate 
initial  values.  The  average  is  from  five  people.  Letters  indi- 
cate conditional  relationships  as  perceived  by  team  members: 

A:  The  impact  is  positive  until  EU  reach  50  percent 

of  maximum,  then  the  Impact  is  negative. 

B:  After  1985  there  is  a positive  impact. 

C:  If  TIES  drops  below  75  percent  then  EU  has  a positive 

impact  on  EA. 

Refine  the  Model--Reflnementa  can  be  made  in  the  model  by 
adding  or  deleting  variables,  redefining  the  limits  or  initial 
values  of  variables,  or  modifying  the  cross-impact  values, 

To  tie  the  cross-impact  values  either  to  reality  (items  for 
which  data  are  available)  or  to  estimated  data,  it  is  necessary 
to  relate  all  impact  values  to  rates  of  change.  The  values  in 
the  cross-impact  matrix  are  scaled  by  multiplying  the  values  by 
constant  factors,  co  and  c|3.  To  determine  co,  one  must  decide 
how  much  influence  Variable  A can  have  on  Variable  B in  one  short 
interval  for  a maximum  positive  value,  say  +3.  Suppose  this  change 
is  3 percent.  Then,  in  one  short  interval  (say,  0.1  of  the  fore- 
cast period)  the  scaling  factor  ca  is  calculated  as  follows: 

ca  = tog(l + r)/-o6At  log  A 

co  = log(1.03)/-3  x 0.5  x 0.1  x log(0.5) 

ca  =»  0.  28 

where 

ca  a scaling  factor,  unknown 
r = growth  rate,  3 percent 


151 


At  = time  interval,  0,1 
a = cross-impact  value,  +3 
0 a value  of  the  variable,  0.5 
A « value  of  another  variable,  0.5 

To  determine  c0,  a similar  process  is  used,  except  here  At 
cancels  out.  However,  as  a general  approximation,  c£  can  be  es- 
timated at  10  times  ca. 

Examine  Alternatives --After  the  variables  are  defined  and 
agreed  upon  and  the  cross-impact  matrix  scaled,  the  future  states 
of  the  system  are  simulated.  Thn  system  that  emerged  as  a result 
of  the  team's  cross-impact  structure  is  illustrated  in  Figure  24. 
This  Is  referred  to  as  the  base  case.  Figure  25  illustrates  one 
of  the  numerous  alternatives  tested  with  the  DWF  model. 

Draw  Concluslon8--As  indicated  in  Figures  17  and  18,  KSIM 
runs  reflecting  different  assumptions  point  to  various  specific 
implications  for  the  variables  plotted,,  In  drawing  conclusions 
from  euch  plots,  it  is  well  to  remember  that  all  KSIM  resuLts 
reflect  the  biases  of  the  forecasters,  the  shortcomings  of  the 
model,  and  inadequacies  of  data.  It  is  for  these  reasons  that 
the  process  is  often  fully  as  valuable  as  the  specific,  conclusions 
of  the  work. 
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INPUT -OUTPUT  ANALYSIS 


General  Description 

Abstract 

Input-output  (1-0)  analysis  is  b means  of  interrelating 
industry  inputs  and  outputs  In  a single  model,  showing  the  conse- 
quences to  all  other  sectors  of  a specified  change  in  one.  Dif- 
ferent models  deal  with  the  nation,  with  regions,  with  specific 
industries,  and  so  on.  1-0  analyses  are  of  great  value  in  quan- 
tifying changes  in  a region's  or  subregion's  commodity  flows  and 
likely  industrialization  patterns  resulting  from  specific  projects-- 
such  as  improved  navigational  facilities  or  a new  recreational  site. 
Principal  problems  to  its  use  include  lack  of  detail  in  coverage 
in  1-0  matrices,  out-of-date  data,  and  the  high  coBt  of  developing 
speciality  1-0  tables. 

Definition 

Input-output  analysis  is  based  upon  a descriptive  model  of 
the  economy  or  a portion  of  it.  1-0  refers  to  the  flow  of  goods 
and  services  among  industries  during  the  process  of  manufacture 
and  then  to  final  users  (or  GNP).  1-0  tables  are  constructed  to 
show  thin  flow  either  for  all  industries  and  final  users  or  for  a 
selected  group  of  industries  and  final  users.  An  1-0  table  may 
show  the  flow  of  goods  and  services  with  a metropolitan  area,  state, 
a nonpolitical  region,  such  as  a river  basin,  a country,  or  even 
a group  of  countries.  It  customarily  includes  all  the  transactions 
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or  flows  of  goods  and  services  that  occur,  cr  are  expected  to 
occur,  in  a particular  year,  1-0  tables  are  usually  produced 
in  each  of  three  different  forms:  one  covering  dollar  transac- 

tions, one,  direct  requirements,  and  one,  total  requirements, 

1-0  analysis  is  the  use  of  1-0  tables  and  projections  to 
assist  in  tracing,  predicting,  or  evaluating  the  effect  on  a par- 
ticular industry  or  region  of  changes  in  the  demand  for  goods  and 
services  by  final  users  and  by  other  industries.  Many  1-0  tables 
have  been  computerized  to  make  it  easier  to  insert  desired  changes. 

Assumptions 

The  central  concept  in  1-0  is  "the  idea  that  there  is  a fun- 
damental relationship  between  the  volume  of  the  output  of  an  in- 
dustry and  che  size  of  the  inputs  going  into  it"  (Leontief,  1966). 
Its  usefulness  rests  on  the  assumption  of  a stable  pattern  of  those 
relationships.  The  basic  assumptions  are  as  follows: 

• Each  commodity  is  produced  by  a 3ingle  sector--here 
the  main  problem  is  one  of  aggregation. 

• Inputs  to  each  sector  are  a direct  linear  function  of 
that  sector's  output.  Within  the  static  model,  this 
means  that  technology  does  not  change  over  time--an 
assumption  that  is  hard  to  live  with  in  the  1970s. 

• There  are.  no  externalities  involved  in  the  production 
process,  suggrsting  a state  of  self-sustaining  growth. 
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History 

Interindustry  1-0  analysis  received  its  present-day  impetus 
from  Wassily  W.  Leontief,  Nobel  Prize  winner  of  Harvard  University, 
who  published  the  first  national  1-0  table  in  1936.  The  basic  con- 
cept of  a table  of  the  economy  was  developed  nearly  two  centuries 
ago  by  Francois  QueBnay.  Then  in  the  early  1900s,  Leon  Walras  de- 
veloped the  mathematical  equations  for  the  economic  principles. 
During  the  past  15  years,  many  national  1-0  tables  have  been  de- 
veloped for  studying  and  projecting  economic  growth  patterns  and 
the  potential  Impact  of  major  policy  moves.  Over  60  countries  now 
have  a table  of  some  kind,  and  a single  integrated  table  has  been 
published  for  the  European  Common  Market.  In  addition,  a number 
of  regional  1-0  tables  have  been  developed  for  individual  states, 
multistate  regions,  major  watersheds,  and  metropolitan  areas.  The 
most  recent  national  X-0  table  for  the  United  States  was  published 
by  the  Department  of  Commerc  In  1974. 

Water-related  multiregional  1-0  tablas  have  been  developed  at 
the  University  of  California  at  Berkeley  (Davis,  1968).  Computer 
programs,  documentation,  and  certain  data  are  available  as  part 
cf  the  U.3.  Army  Corps  of  Engineers  SIRAP  program  housed  at  the 
Lawrence  Berkeley  Laboratory.  A multiregional  1-0  model  developed 
at  Harvard  for  EDA  is  available  on  EEA  computers  and  SIRAP.  There 
are  51  state  tables  (including  the  District  of  Columbia).  IWR  has 
developed  procedures  for  converting  state  tables  into  a total  of 
four  regions.  The  smallest  size  is  one  OBERS  region. 
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Main  Uses 


The  Corps  of  Engineers  could  use  1-0  for  studies  designed 
to  reveal  the  interrelationships  between  various  sectors  cf  the 
economy  and  the  marginal  value  of  water  within  such  a structure 
in  stimulating  or  inhibiting  economic  growth.  For  this  purpose 
the  technique  has  unique  capabilities.  With  the  development  of 


water-use  1-0,  matrices  have  been  used  more  as  a means  for  struc* 


turing  and  representing  information  than  for  generating  new  infor- 


mation. 


Through  the  use  of  coefficients.  1-0  models  can  forecast  not 


only  those  sectors  of  the  economy  directly  responsible  for  the 


consumption  of  water,  but  also  those  industries  that  exert  consid- 


erable indirect  demands  for  water  through  interrelationships  with 
other  aectors  in  the  economy.  Combined  with  optimizing  techniques 
such  aa  linear  programming,  a time  path  of  "shadow  prices"  of 
water  can  be  identified  for  productive  sectors  of  the  economy 
dependent  upon  water  availability. 


Limits  and  Cautions 


Two  basic  cautions  must  be  observed  in  using  1-0  analyses: 


First,  data  for  1-0  tables  are  usually  fairly  old.  For  exam- 
ple, the  national  industry  table  issued  late  in  1969  used  informa- 
tion collected  in  1963.  The  1974  update  uses  1967  data.  On  the 
average,  tables  reflect  industry  flows  and  technologies  of  about 
eight  years  earlier.  This  is  a serious  deficiency,  since  the  econ* 


omy  and  technology  are  far  from  static.  To  remedy  the  situation, 
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some  analysts  have  attempted  to  update  old  data  by  estimating 
new  technical  coefficients  linking  sectors  of  the  ficonomy. 

Second,  data  often  are  not  fine  enough  for  all  the  analyses 
one  slight  wish  to  make.  The  1969  national  table  covers  367  in- 
dustrial sectors.  Enormous  as  this  is,  there  is  often  need  for 
specific  data  on  regions  and  localities  and  for  nonindustry  cate- 
gories. Resort  may  be  had  to  specialty  tables  developed  by  pri- 
vate organisations.  These  sometimes  are  more  directly  pertinent, 
but  unfortunately  they  often  use  data  and  coefficients  of  question- 
able validity,  Moreover,  it  la  extremely  difficult  to  update  co- 
efficients for  fact-changing  domains  of  the  economy. 

Other  Techniques 

1-0  ia  clearly  superior  to  other  cross-impact  and  relevance 
techniques  for  measuring  many  kinds  of  interindustry  relationships. 
In  terms  of  accounting  systems,  the  alternatives  are  national  in- 
come accounts,  flow  of  funds,  balance  of  payments,  and  wealth  and 
balance  sheets.  However,  no  other  method  attempts  to  compete  with 
1-0  tn  furnishing  a comprehensive  description  of  the  interindustry 
relationships  within  a region,  or  a detailed  analysis  of  the  impact 
of  change  in  the  national  economy. 

Product  or  Result 

An  I— 0 table  consists  of  a matrix  with  Identical  industry  (or 
other)  categories  on  each  side.  In  each  cell  appears  a number 
(a  coefficient)  that  indicates  the  relationship  of  the  industry 
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sector  identified  on  one  axis  of  the  matrix  to  the  sector  on  the 
other  axis.  In  total,  the  matrix  defines  interrelationships  among 
all  sectors  treated  in  the  table.  Different  tables  reflect  dollar 
flows,  direct  interindustry  requirements*  and  total  requirements. 
Forecasts  from  a water  content  matrix  cun  illustrate  water  require- 
ments and  water  withdrawal  requirements.  The  i: suits  can  also  pro- 
vide an  indicator  of  water  use  by  industry. 

Level  of  Detail 

Results  are  extrnmely  detailed. 

Level  of  Confidence 

An  1-0  table  projection  can  be  no  better  than  the  individual 
forecasts  of  final  demand  (GNP)  and  the  industry  input  coefficients 
that  are  combined  to  make  it  up.  Confidence  in  thesi  nutters  de- 
pends largely  on  one's  expectations  and  grasp  of  what  is  and  la 
not  Included.  Use  of  automated  data  reduces  confidence.  Never- 
theless, there  is  widespread  agreement  that  1-0  relationships  war- 
rant more  confidence  than  those  derived  in  other  ways.  Regional 
1-0  analysis  Is  extremely  sensitive  to  changing  trade  patterns. 

Communicability  of  Results 

In  a technical  sense,  communicability  is  very  low.  Results 
are  usually  presented  in  technical,  mathematical  form  and  reflect 
great  numbers  of  hidden  assumptions.  For  example,  roots  and  bases 
of  the  forecasts  used  in  developing  tables  are  rarely  understood 
In  detail. 
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In  a general  sense,  the  concept  of  levels  of  Interdependence 
among  industries  is  easy  to  grasp. 

Credibility  of  Results 

Credibility  is  good  in  the  sense  that  1-0  data  often  are  the 
best  available  anywhere^  It  is  not  good  in  the  et^nse  that  few 
practitioners  believe  it  is  possible  to  develop  truly  accurate 
and  up-to-date  tables, 

Span  of  Forecasts 

1-0  is  usually  used  for  short-  to  medium-range  forecasts. 
Although  It  could  be  used  for  long-range  forecasting,  it  is  not 
uniquely  edepted  for  that  purpose. 

Resources  Needed 

Given  a suitable  1-0  'table, ‘ much  analytical  work  can  be  done 

1 1 

with  it  by  personnel  of  minimum  training  without  an  excessive  ex- 
penditure of  time. 

The  situation  is  very  different  if  a more  specialized  table 

a.  ,■  ' 

must  be  devised  or  if  an  old  table  must  be  updated.  Cost  and  time 
requirements  exceed  the  capabilities  of  all  but  large  organizations. 
Generally,  it  is  best  to  pay  a qualified  consulting  firm  to  develop 
the  information  if  it  is  determined  that  the  cost  of  a new  table 
is  warranted. 

Access  to  a high-speed  computer  is  a must  for  1-0  analysis. 
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Procedures 


As  indicated  above,  it  is  one  thing  to  use  1-0  tables  and  an 
altogether  different  thing  to  construct  a table.  The  first  is 
relatively  easy;  the  second  is  a task  for  a large  group  of  spe- 
cialists. 

In  view  of  this,  we  make  no  attempt  In  this  Handbook  to  in- 
struct planners  in  the  building  of  1-0  tables.  Instead,  we  quote 
several  excellent  pages  on  how  one  reads  such  tables. 

Onoe  one  understands  the  tables,  they  can  be  used  by  planners 
in  two  procedurally  different  ways. 

First,  as  shown  in  Figure  16  at  the  start  of  Section  IV,  1-0 
data  can  be  used  to  feed  into  comprehensive  computerised  simula- 
tions such  as  KSIM  or  dynamic  models. 

Second,  1-0  can  be  used  to  forecast  the  implications  of  spec- 
ified changes  by: 

• Assuming  an  event  affecting  a given  Rector,  Buch  as 
adding  agricultural  output  by  increasing  water  sup- 
plies. 

• Estimating  impacts  on  the  sector's  Inputs  and  outputs. 

• Recalculating  coefficients  among  sectors  as  a result 
of  the  introduced  event, 

• Tabulating  the  results  of  the  change  in  one  sector  on 
all  Interconnected  sectors  together  with  the  feedback 
implication  for  the  original  sector. 
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Case  Example 


Description  of  a Regional  Interindustry  Economic  Trans- 
actions Model  (Quoted  from  Davis  and  Lofting,  1973) 

" 1 . Partial  vs.  General  Equilibrium  Analysis 

"The  economic  activities  within  a region  may  at  times 
be  grouped  into  a number  of  Industries  or  sectors  in  order  to 
facilitate  economic  analysis.  These  sectors  will  not  generally 
be  independent  of  each  other  as  there  will  usually  be  flows  of 
goods  and  services  between  the  sectors.  Judgements  as  to  the 
nature  and  extent  of  these  flows  will  govern  the  choice  between 
a partial  or  general  equilibrium  approach  to  the  analysis  of  many 
regional  economic  issues. 

"Suppose  the  analyst  is  interested  in  the  effects  upon 
a particular  sector  of  a change  in  the  market  demand  for  its  pro- 
duction. It  may  be  that  the  resulting  change  in  the  sector's  pro- 
duction will  have  repercussions  on  other  sectors  in  the  regional 
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FIGURE  28  CONDITIONS  FOR  PARTIAL  EQUILIBRIUM  ANALYSIS 


economy.  Moreover,  these  repercussions  may  in  turn  affect,  or 
feed  back  upon,  the  sector  in  question.  The  basic  assumption  of 
partial  equilibrium  analysis  is  that  such  feedback  to  the  sector 
under  study  is  sufficiently  small  to  be  Ignored. 

"On  the  other  hand  general  equilibrium  analysis  is  ap- 
propriate if  feedback  upon  the  sector  is  significant  or  if  the 
analyst  is  Interested  in  the  effects  (impact)  of  the  initial  stim- 
ulus upon  other  sectors  of  the  regional  economy.  Under  general 
equilibrium  analysis,  relationships  between  sectors  of  the  economy 
are  explicitly  taken  into  account  and  the  entirety  of  the  economy 
is  brought  under  examination. 

Impact 


Ulgnlflcant) 

FIGURE  27  CONDITIONS  FOR  GENERAL  EQUILIBRIUM  ANALYSIS 
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"In  a pure  equilibrium  model  each  variable  in  the  model 
depends  only  upon  other  variables  within  the  model  and  hence  all 
variables  are  endogenous.  That  is,  values  for  all  variables  are 
yielded  by  the  model  and  none  must  be  determined  exogenously. 

"In  the  1930a  Wassily  Leontlef  formulated  a mathematical 
description  of  the  U.S.  economy  constructed  from  data  regarding 
economic  transactions  between  industries.  The  effort  stands  as 
the  first  operational  economic  model  to  embody  the  essence  of  gen- 
eral equilibrium.  The  model  is  not  strictly  a pure  equilibrium 
model  since,  as  we  shall  see,  soma  of  the  key  variables  of  the 
model  are  exogenous,  l.e.r  values  for  these  variables  muBt  be 
determined  outside  the  model  itself  and  then  'plugged  in.' 

"Leontlef 'a  model  came  to  be  labelled  'input-output1  as 
it  records  each  transaction  between  firms  in  double  entry  fashion 
as  both  a sale  of  output  and  a purchase  of  input.  The  model  rep- 
resents a general  equilibrium  approach  to  the  study  of  an  economy 
and  focuses  upon  the  interdependencies  between  the  various  economic 
sectors.  Although  Initially  applied  on  a national  level,  the  model 
has  been  used  in  a proliferation  of  regional  applications  in  recent 
years. 


"2,  The  Regional  Input-Output  Model 

"The  basic  X-0  model  may  be  explained  in  terms  of  its 
three  associated  tables; 

a.  Table  of  Interindustry  Transactions 

b.  Table  of  Direct  Requirements 

c.  Table  of  Direct  Plus  Indirect  Requirements 
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"a.  Table  of  Interinduacry  Transactions 

"As  a fir at  a tap  in  the  construction  of  the  Trans- 
actions Table  the  regional  economy  is  segmented  into  a number  of 
sectors  (or  industries).  Just  what  sectors  the  analyst  chooses 
to  represent  the  economy  depends  upon  1)  the  nature  of  the  regional 
economy  with  which  he  is  working,  2)  the  nature  of  the  problem  in 
which  he  is  Interested,  and  3)  the  resources  at  his  disposal.  The 
number  of  sectors  of  the  typical  regional  1-0  model  will  be  In  the 
neighborhood  of  30.  Each  of  these  sectors  is  generally  defined 
In  terms  of  the  Standard  Industrial  Clasaification  (SIC)  codes.* 
Every  type  of  economic  activity  may  be  represented  by  an  SIC  code  / 
number  at  the  2-digit,  3-digit  or  4-digit  level.  For  example,  a 
fertilizer  manufacturer  would  be  classified  at  the  4-digit  level 
as  belonging  to  the  category:  2871  Fertilizers.  If  we  were  to 

aggrugate  our  SIC  classification  to  the  3-digit  level  the  firm 
would  be  classified  under  the  heading  of  287  Agricultural  Chemicals. 
If  we  were  to  collapse  our  categories  to  the  2-digit  level  our  firm 
would  fall  into  the  28  Chemicals  and  Allied  Products  classification. 
There  are  currently  79  two-digit  classifications,  which  comprise 
10  divisions.  For  example,  SIC  28  is  contained  within  Division  D- 
Manufacturing. 

"However  the  factors  are  defined,  it  is  essential 
that  taken  together  they  encompass  the  entirety  of  economic  activ- 
ity within  the  region.  For  illustrative  purpose,  the  following 


Technical  committee  on  Industrial  Classif ication,  Office  of  Sta- 
tistical Standards,  Standard  Industrial  Classification  Manual. 
Washington,  D.C.,  1957. 
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interindustry  Transactions  Table  contains  only  3 sectors  or  in- 
dustries. 


Table  [19] 

Transactions  Table  ($1000) 


Purchasers 

Final 

Demand 

Gross 

Output 

Agri- 

culture 

Manufac- 

turing 

Services 

UJ 

u 

Agriculture 

10 

5 

5 

50 

70 

O 

*H 

H 

Manufacturing 

20 

30 

25 

25 

100 

4) 

C/3 

Services 

5 

10 

_ .....  1 

10 

55 

80 

Imports 

5 

15 

5 

Value  added 

30 

40 

35 

Gross  outlay 

70 

100 

80 

"Since  each  sector  both  buys  from  and  sells  to  other 
sectors  within  the  economy  for  further  processing,  each  of  the 
three  sectors  la  listed  both  at  the  left  of  the  table  as  a seller 
and  at  the  top  of  the  table  as  a purchaser.  The  3x3  matrix 
formed  by  these  sectors  is  referred  to  as  the  'processing'  matrix. 

"The  final  demand  sectors  represent  all  saleB  that 
are  made  not  for  further  processing  within  the  region  but  for  final 
consumption  by  Households,  Government,  Investment,  and  Exports.  If 
a farmer  sells  milk  to  a restaurant,  the  transaction  is  from  Agri- 
culture to  Services;  if  the  farmer  Bells  milk  to  a household  the 
transaction  is  from  Agriculture  to  Final  Demand  (Households).  If 


a steel  mill  sells  to  a metal  fabricating  plant  within  the  region, 
it  is  a transaction  between  Manufacturing  and  Manufacturing;  if 


the  mill  sells  to  a metal  fabricating  plant  outside  the  region, 
it  la  a transaction  from  Manufacturing  to  Final  Demand  (Export). 
Thus  each  sector's  sales  are  recorded  as  satisfying  either  inter- 
mediate  (processing)  or  final  demand.  Gross  Output  (total  sales) 
of  each  sector  is  the  sum  of  intermediate  and  final  sales.  Read- 
ing along  any  of  the  first  three  rows,  we  can  see  how  each  sector 
distributed  itB  output  over  the  period.  Manufacturing,  for  exam- 
ple, sold  $20,000  of  its  $100,000  total  output  to  Agriculture, 
$30,000  to  Manufacturing,  $25,000  to  Services,  and  the  remaining 
$25,000  to  Final  Demand. 

"Reading  down  any  of  the  first  three  columns  we  may 
see  how  the  particular  sector  purchased  input.  For  example,  Manu- 
facturing purchased  $5,000  from  Agriculture,  $30,000  from  Manufac- 
turing, $10,000  from  Services/  $15,000  from  Imports  (goods  and 
services  produced  outside  the  region),  and  $40,000  from  the  Value 
Added  sector  (roughly  wages  j^nd  salaries,  rents,  Interest,  depre- 
ciation, dividends,  and  profit).  Gross  Outlay  (total  purchases) 
must,  equal  GroBs  Output  (total  sales)  as  profits  are  considered 
to  be  the  remuneration  to  management  and  thuB  serve  as  the  balanc- 
ing Item.  That  is,  total  sales  revenue  is  equal  to  to  total  cost 
plus  profit.  This  point  1b  emphasited  below  by  the  diagram  repre- 
senting dollar  flows  into  and  out  of  a sector. 
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FIGURE  28  SECTORAL  MONETARY  FLOWS 

"The  dollar  flows  are  normally  those  that  have  been 
recorded  over  a period  of  one  year  and  data  pertaining  to  the-'ffows 
are  gathered  by  personal  and/or  mail  interviews  with  each  of  the 
firms  or  a sampling  of  the  firms  within  each  of  the  Bectors. 

"b.  Table  of  Direct  Requirements 

"The  Table  of  Direct  Requirements  or  coefficients 
is  formed  by  dividing  the  entries  in  each  column  of  the  processing 
matrix  by  their  respective  column  total  (Gross  Outlay).  The  Direct 
Coefficients  Table  of  our  illustrative  1-0  model  is  Table  [20], 

"Table  [20]  reveals  that  for  the  average  dollar 
spent  by,  say,  Agriculture  during  the  period,  14c  were  spent  on 
Agricultural  inputs,  29c  on  inputs  from  Manufacturing,  and  7c  on 
Services.  Under  the  assumption  that  these  coefficients  remain 
fixed,  we  can  forecast  the  effect  upon  the  regional  economy  result- 
ing from  an  increase  in  Final  Demand, 
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Table  [20] 


TABLE  OF  DIRECT  REQUIREMENTS  PER  DOLLAR  OF  GROSS  OUTLAY 


Agriculture 

Manufacturing 

Services 

Agriculture 

.14 

.05 

.06 

Manufacturing 

.29 

.30 

.31 

Services 

.07 

.10 

.12 

"To  Illustrate,  let  us  assume  that  the  export  de- 
mand for  the  output  of  our  regional  manufacturing  sector  Increases 
by  $10,000.  The  manufacturing  sector  will  increase  Its  output  by 
$10,000  to  meet  this  rise  in  final  demand  and  to  do  so  will  have 
to  make  the  following  purchases: 


Manufacturing:  $10,000 

Agriculture 

$10,000  x .05  = $ 500 

Manufacturing 

$10,000  x .30  = $3,000 

Services 

$10,000  x .10  =»  $1,000 

"However,  in  order  to  produce  this  supporting  out- 
put, each  sector  will  require  the  following  Inputs: 


Agriculture: 

$500 

Manufacturing: 

$3,000 

Services: 

$1,000 

Total 

Agriculture 

500x, 14  » $ 70 

3000X.05  = $150 

lOOOx . 06  * $ 60 

$ 280 

Manufactur- 

ing 

500x. 29  - $145 

’OOOx. 30  * $900 

lOOOx.31  = $310 

$1,355 

Services 

500x.G7  = $ 35 

3000x.l0r-  $300 

lOOOx. 12  = $120 

$ 455 

"Lese  requirements  will  set  off  a third  round  of  spending: 


Agriculture: 

$280 

Manufacturing: 

$1355 

Services: 

$455 

Total 

Agricul- 

ture 

280  x,  14  = $39. 20 

1355  x.05a$  67.75 

455  x.06»$  27.30 

$124.25 

Manufac- 

turing 

280  x.  29 -$81.20 

1355 x. 30- $406. 50 

455  x.  31*  $141.05 

$628.75 

Services 

280  x. 07 *$19. 60 

1355  x,  10  = $135.50 

455  x.  12*  $ 54.60 

$209.70 

"These  rounds  of  spending  will  continue  with  each 
round  becoming  weaker  in  its  effects.  The  accumulated  increases  in 
total  sales  of  each  sector  resulting  from  the  stimulus  to  the  Manu- 
facturing sector  of  $10,000  in  export  demand  can  be  computed  from 
the  Increase  in  sales  of  each  round. 

"While  such  series  of  calculations  are  helpful  in 
understanding  the  effects  that  reverberate  throughout  the  regional 
economy  from  the  initial  stimulus,  fortunately  they  are  not  neces- 
sary to  determine  the  ultimate  effects.  The  final  changes  in  total 
aaleB  (Gross  Output)  of  each  sector  can  be  read  directly  from  the 
third  table  of  the  1-0  model,  the  table  of  direct  plus  indirect  re- 
quirements. 


"c.  Table  of  Total  (Direct  Plus  Indirect)  Requirements 

"Generally,  with  the  aid  of  a computer,  our  third 
table  may  be  constructed  through  inversion  of  a matrix,  associated, 
as  we  Bhall  see  in  the  following  section,  with  our  second  table. 

For  our  illustrative  model  the  table  is  Table  (21]. 
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Table  [21] 

TABLE  OF  DIRECT  PLUS  INDIRECT  REQUIREMENTS 
PER  DOLLAR  OF  DELIVERY  TO  FINAL  DEMANDS* 


Agriculture 

Manufacturing 

Services 

Agriculture 

1.2117 

0.5677 

0.1637 

Manufacturing 

0. 1042 

1.5542 

0.1861 

Services 

0.1237 

0.5956 

1.2210 

Transposed 


"Table  [21]  tells  us  that  If  there  is  a $1  increase 
in  the  final  demand  for  Agriculture,  the  total  output  of  Agricul- 
Lure  will,  after  all  the  interdependent  transactions  have  worked 
themselves  out,  increase  by  $1.21.  Manufacturing  and  Services  in 
this  case  will  rise  $0.57  and  $0.16  respectively.  We  can  now 
easily  read  from  the  table  the  effects  of  a $10,000  increase  in 
exports  of  Manufacturing.  Total  sales  of  Agriculture  will  rise 
$1,000  ($10,000  x 0.10),  Manufacturing  sales  will  increase  $15,500 
($10,000  x 1.55)  and  the  output  of  the  Services  sector  will  expand 
by  $1,900  ($10,000  x 0.19)." 
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POLICY  CAPTURE 


General  Description 

Abstract 

"Policy  capture"  involves  building  a model  that,  given  the 
same  information  the  individual  has,  will  accurately  reproduce 
his  judgments  and  hence  his  "policies,"  The  goal  is  not  simply 
to  predict  or  reproduce  judgments  accurately;  rather  policy  cap- 
ture seeks  to  generate  descriptions  of  the  judgmental  behavior 
that  are  helpful  in  identifying  characteristic  differences  be- 
tween Individuals,  It  is  felt  that  the  judgmental  process  can 
be  described  mathematically  with  a reasonable  amount  of  success. 

The  technique  has  greatest  Corps  application  in  the  areas  of  pub- 
lic participation  and  the  evaluation  of  the  trade-offs  among  var- 
ious goals  and  alternatives. 

Definition 

In  general  terms,  capturing  a person's  judgment  policy  means 
constructing  a mathematical  description  of  that  policy  that  can 
be  used  both  to  understand  present  judgments  and  to  predict  future 
judgments.  The  technique  utilises  multiple  regression  analysis  to 
"capture"  the  relative  weights  a person  gives  to  the  accomplishment 
of  various  objectives.  Thus,  the  method  yields  mathematically  cal- 
culated measures  co  reveal  preferences.  In  water  resource  planning, 
policy  capture  can  be  used  to  show  the  weights  various  planners, 
decision  makers,  and  publics  use  in  gauging  such  objectives  as 
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t;v,  j environmental  quality,  national  efficiency,  and  regional  develop- 

meat.  In  the  procedure,  people  are  asked  to  rate  alternative 
| projects  that  specify  different  budget  allocations  for  these  ob- 

k jectives  (Johnson,  1973). 

(S 

?£ 

Assumptions 

$ Differences  In  judgment  Are  considered  to  be  a major  source 

of  conflict  and  misunderstanding.  This  approach  takes  the  view- 
?■  point  that  the  best,  and  perhaps  the  only  way  to  obtain  an  accurate 

description  of  judgment  policy  la  through  an  empirical  analysis 
of  actual  judgments.  The  assumption  is  that  mathematical  analyses 
of  judgments  can  exhibit  and  clarify  the  differing  policies  that 
are  the  causes  of  differing  Judgments.  Moreover, , the  level  of 
analysis  Is  considered  worth  the  effort,  on  the  basis  that  con- 
flict often  is  the  result  of  honest  differences  in  Judgment  policy, 
rather  than  competing  self-interests,  and  that  Illumination  of 
this  point  increases  understanding  and  promotes  conditions  favor- 
able to  conflict  reduction  and  management,  if  not  conflict  reso- 
lution (Stewart  and  Gelberd,  1973). 


History 


The  policy  capture  technique  was  developed  by  Dr.  Kenneth 
Hammond  in  the  early  1970s  at  the  Institute  of  Behavioral  Science, 
University  of  Colorado,  Boulder,  Colorado  (Hammond,  1974).  It  ts 
baaed  on  classic  concepts  of  Judgment  theory  by  Tolman  and  Brunswik 
doting  back  forty  years. 


*Vs  ’ WJhfc  mfrJIimSJiflfcHdi  in  V-*- 
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Policy  capture  has  been  applied  In  the  areas  of  the  public 
sector  for  policy  analysis,  government  planning,  citizen  partici- 
pation, community  goals,  and  land  use  allocation.  In  the  private 
sector,  applications  Include  award  of  loans,  forecasting  interest 
rates,  business  promotions,  and  conflict  resolution  in  labor  man- 
agement. 

Main  Uses 

The  procedures  are  flexible  enough  to  be  useful  for  a wide 
variety  of  problems.  The  analysis  may  be  carried  out  in  any  de- 
sired degree  of  depth,  from  a limited  study  (l.e.,  allocation 
funds  among  five  categories)  to  an  extensive  study  involving  a 
variety  of  procedures  and  objectives.  The  major  contributions 
are  that  it  externalizes  the  decision  process,  gives  an  objective 
basis. for  communication  among  decision  makers,  and  provides  a model 
for  repetitive  decisions.  Policy  capture  can  be  an  effective  means 
of  including  both  individual  citizens  and  representatives  from 
stakeholder  groups  in  the  planning  process.  It  is  an  excellent 
public  participation  tool  because  it  allows  citizens  to  make  judg- 
ments about  combinations  of  goals  and  to  evaluate  trade-offs, 

Limits  and  Cautions 

Three  general  cautions  or  pitfalls  are  associated  with  the 
policy  capture  procedure.  First,  it  is  difficult  to  select  appro- 
priate variables  with  which  to  work;  moreover,  the  form  in  which 
they  are  presented  is  critical  to  the  methodology.  Second,  due 
to  time  requirements,  it  is  often  difficult  to  involve  high-level 
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decision  makers.  The  people  who  carry  out  Che  analysis  must  be 
interested  (take  it  seriously),  repeat  the  process  several  times, 
and  be  properly  guided.  Finally,  the  use  of  linear  regression 
has  drawbacks  for  conducting  trade-off  analyses.  Crews  and  John- 
son (1974)  suggest  a nonlinear  multivariate  regression  model  as  a 
more  appropriate  model  to  describe  complex  human  thought  patterns 

With  respect  to  public  participation,  it  is  difficult  to  pre- 
dict the  "typical"  member  of  an  interest  group  since  all  members 
have  different  Judgment  policies.  It  must  also  be  emphasised 
that  to  predict  Judgments  is  not  to  predict  behavior  since  an 
individual's  behavior  is  situation-dependent.  Hence,  in  any 
given  situation  the  predicted  Judgments  may  not  reflect  actual 
behavior.  Judgments  of  citlsens  are  important  because  they  re- 
flect values  and  beliefs  about  what  should  be.  They  also  indi- 
cate public  acceptance  or  rejection,  but  they  do  not  fully  pre- 
dict the  conrequences  of  alternative  policies. 

Other  Techniques 

The  basic  technique  used  in  policy  capture  partakes  of  both 
attltudinal  surveys  and  mathematical  regression  analysis.  The 
closest  alternative  to  a policy  capture  would  be  to  administer 
a questionnaire  or  conduct  a survey.  However,  the  policy  capture 
approach  has  been  developed  more  explicitly  than  other  survey 
techniques  for  dealing  with  the  Judgmental  intangibles  and  thus 
is  important  to  policy  decisions, 
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Product  or  Result 


Policy  capture  makac  explicit  the  priorities  end  trade-offs 
among  goals.  The  technique  can  reveal  the  relative  importance 
of  community  goals  as  well  as  the  diversity  of  citizen  views. 

It  indicates  what  cues  (dimensions)  were  actually  used  by  the 
"decision  maker"  and  what  importance  (weight)  was  placed  on  the 
cues  that  were  usad.  Mechanically  precise  calculation  of  the 
amount  o£  increase  in  Category  X needed  to  exactly  compensate 
for  a given  decrease  in  Category  Y is  possible.  Furthermore, 

the  discovery  of  curvilinear  function  formB  implies  that  trade- 

* 

offs  would  not  be  constant  across  all  levels  of  spending.  For 
example,  the  fact  that  trade-offs  among  spending  categories  vary 
with  levels  of  spending  would  almost  certainly  not  emerge  in 
public  hearings  or  in  written  budget  recommendations,  yet  income 
elasticities  are  known  to  be  of  great  importance  in  making  budget 
decisions  (Stewart  and  Gelberd,  1973). 

There  are  two  types  of  results  from  a policy  capture;  par-' 
tlcipant  feedback  graphics  (illustrating  weights  and  functions), 
and  numerical  computations  from  the  regression  and  cluster  analy- 
sis. The  graphs  Indicate  the  relative  importance  of  each  dimen- 
sion of  the  problem  to  the  person  in  making  his  judgments.  Large 
weights  (in  the  form  of  bar  charts)  indicate  a large  effect  on 
Judgments  of  desirability.  Small  weightB  indicate  relstive  in- 
difference. Functions  (Illustrated  as  plots)  show  the  form  of 
the  relationship  between  the  information  used  to  make  judgments 
and  the  judgments. 
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Level  of  Detail 


Detail  of  results  reflects  the  nature  of  the  problem.  The 
method  Is  applicable  to  both  broad  and  specific  issues. 

Level  of  Confidence 

The  predictive  accuracy  can  be  extremely  high.  Mathematical 
policy  capturing  techniques  can  predict  the  judgments  of  the  in- 
terest group  members  with  an  accuracy  (correlation)  ranging  from 
0.71  to  0.94  with  a median  of  0.81.  Work  by  Stewart  and  Steinmann 
on  consistency  and  reliability  of  the  desirability  judgments  indi- 
cates that  the  method  is  appropriate  for  a large  portion  of  inter- 
viewed people  (sample  size  173)  (Stewart  and  Gelberd,  1973).  More- 
over, the  results  of  a number  of  studies  indicate  that  when  "judges" 
are  shown  descriptions  of  the  Judgment  policies  of  group  members, 
in  terms  of  weights  and  function  forma,  then  their  ability  to  pre- 
dict the  Judgment  of  others  Increases  dramatically  in  the  specific 
situation.  In  short,  it  is  felt  that  policy  capturing  procedures 
can  be  used  effectively  to  increase  understanding.  Again,  it 
should  ,be  emphasized  that  the  technique,  although  it  models  judg- 
ments, does  not  predict  behavior. 

Communicability  of  Results 

This  information  is  in  a precise  numerical  form  that  can  be 
presented  graphically,  understood  easily,  and  used  in  further  anal- 
ysis. The  relative  importance  of  the  various  problem  dimensions, 
and  the  trade-offs  among  them  are  made  explicit.  The  analysis 
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applies  whether  trade-offs  are  constant  or  vary  with  levels  of 
dimensions.  This  approach  can  result  in  a significant  improve- 
ment in  the  quality  and  utility  of  citizen  input. 

Credibility  of  Results 

Students  of  the  method  find  it  highly  credible  and  can  back 
up  claims  with  data  (see  comment  under  "Level  of  Confidence"). 

On  the  other  hand,  most  laymen  tend  to  think  their  Judgments  are 
essentially  esoteric  and  unquantif table.  Such  people,  unless 
shown  evidence  to  the  contrary,  have  serious  doubtB  as  to  the 
credibility  of  policy  capture. 

Resources  Needed 

Besides  au  analyst  or  skilled  user,  the  people  requirements 
are:  decision  makers  who  make  decisions  (judgments)  under  vari- 

ous sets  of  conditions.  The  types  of  judgments  are: 

• Binary--yes  or  no/accept  or  reject 

• Continuous --on  some  scale,  e.g.,  1>10 

• Rank  order. 

In  its  simplest  form,  the  method  can  be  carried  out  in  a 
matter  of  days  at  moderate  coBt. 

Computational  backup  is  required  to  perform  the  multiple 
regressions  that  are  essential  to  this  technique,  More  elaborate 
computer  techniques  ere  available  end  are  diecuased  below  under 
"Special  Comments." 
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Special  Comments 

The  full  potential  of  judgment  policy  capturing  can  sometimes 
be  realized  only  with  the  aid  of  an  interactive  computer  graphics 
device.  Such  a device  makes  it  possible  to  analyze  the  judgment 
policies  of  one  or  more  people  and  to  display  the  results  immedi- 
ately. The  terminals  have  been  located  in  public,  places  (such  as 
shopping  centers,  libraries,  retirement  homes)  for  citizens  to 
record  their  judgments  and  receive  immediate  feedback.  The  pro- 
gram operates  with  an  inexpensive  computer  terminal  linked  by 
telephone  to  a large  timesharing  network.  The  program  and  user 
manual,  Policy  II,  are  available  for  Corps  use  via  K.  R.  Hammond 
Associates,  Boulder,  Colorado,  80302  (phone  303-449-8206).  Ini- 
tial costs  range  from  zero  to  $2,000,  depending  on  the  user  ap- 
plication. 

Procedures 

Planners  inexperienced  in  policy  capture  will  require  the 
guidance  of  a consultant  in  establishing  and  carrying  out  proce- 
dure. There  is  no  reason,  however,  why  the  planner  cannot  be  an 
effective--even  a directing--partlclpant  in  such  forecasting  right 
from  the  start. 

Case  Example 

Policy  Capture  of  National  Options 

Policy  capture  is  used  to  measure  the  relative  preference  of 
Individuals  for  competing  issues.  To  illustrate  the  procedure, 


we  present  a hypothetical  trade-off  analysis  between  national 
economic  development  and  environmental  quality.* 

Formulate  the  Problem--Trade-Off  Analysi8--In  this  simple 
case  we  assume  a situation  in  which  two  decision  makers  (A  and  B) 
are  faced  with  the  problem  of  defining  a compatible  mix  between 
two  conflicting  issues:  National  Economic  Development  (NED)  and 

Environmental  Quality  (EQ).  It  is  anticipated  that  a series  of 
alternatives  are  available  in  which  the  two  Issues  are  associated. 

Select  the  Issues--Identify  and  Measure--The  issues  identi- 
fied for  the  trade-off  analysis  are  typically  aggregate  concepts 
such  as,  in  this  case,  economics  and  environment.  In  order  to 
use  the  procedure,  numerical  measures  muBt  be  stipulated  for  each 
issue,  The  economic  issue  (NED)  is  measured  in  dollars  and  re- 
flects the  gross  national  product  per  capita.  NED  data  range  from 
$1,000  to  $20,000.  Environmental  issues  combine  aspects  of  per- 
ceived air,  water,  and  land  quality.  These  aspects  are  aggregated 
into  an  environmental  quality  index  with  values  ranging  from  0.1, 
indicating  a foul  environment  to  a utopian  environment  (0.9). 

Develop  Alternatives--Generate  Scenario--To  determine  prefer- 
ence, alternative  scenarios  are  developed  as  probable  futures  for 
consideration  by  Planner  A and  Planner  B.  Each  future  condition 
describes  a possible  situation  that  could  exist  in  the  real  world 


This  procedure  was  adapted  from  a paper  by  James  E.  Crews  and 
G.  P.  Johnson,  "A  Methodology  for  Trade-Off  Analysis  in  Water 
Resource  Planning,"  Journal  of  Technology  Assessment,  in  press 
1975. 


181 


£ 

I 

w 


k 


in  terms  of  levels  of  achievement  of  NED  and  EQ.  For  example, 
average  present-day  conditions  in  the  United  State,  might  be  rep- 
resented  by  Scenario  5 (Table  22).  This  scenario  depict,  a situ, 
ation  in  which  the  GNP  per  family  1«  $10,000  and  there  is  a rela 
tively  high  level  of  environmental  quality  (0.7).  Since  policy 

Table  22 

SCENARIOS  WITH  PLANNER  PREFERENCES 


Iaauea  Preferences  . 

Scenario  ~NED~~  EQ,  _ Planner__A  Planner. B 


1 

$20,000 

2 

17,500 

3 

15,000 

4 

12,000 

5 

10,000 

6 

20,000 

7 

7,000 

8 

13,000 

9 

10,000 

10 

7,000 

11 

12,000 

12 

5,000 

13 

20,000 

14 

15,000 

15 

10,000 

16 

17,500 

17 

7,000 

18 

4,000 

19 

2,500 

20 

1,000 

Mean 

$11,300 

Standard 

5,948 

deviation 


0.9 

,0.9 

0.7 

0.7 

0.7 

0.6 

0.8 

0.6 

0.5 

0.5 

0.4 


1,000 

950 

900 

825 

600 

850 

500 

600 

500 

400 

500 


900 

800 

500 

400 

300 

300 

300 

250 

180 

100 

100 


0,4 

150 

90 

0.3 

700 

80 

0.3 

600 

70 

0,3 

500 

60 

0.1 

325 

20 

0.2 

95 

50 

0.5 

200 

30 

0.5 

150 

40 

0.9. 

200 

50 

0.54 

527 

231 

0.237 

283 

252 
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capture  is  based  on  statistical  theories,  it  is  essential  that  a 
number  of  choices  or  alternatives  be  available.  In  this  case, 

20  alternative  scenarios  have  been  prepared. 

Rank  Pteferences--Partlcipants  in  the  procedure  score  all 
scenarios  in  order  of  preference.  It  is  helpful  to  use  one  sce- 
nario as  a basis  for  relative  scoring,  In  this  case  Scenario  5, 
representing  present  conditions,  was  used  as  a starting  point. 
Planners  were  Instructed  to  first  score  Scenario  5,  and  then  score 
all  other  scenarios  relative  to  Scenario  5,  The  preference  Bcores 
shown  in  Table  22  could  range  in  value  from  1 to  1,000  indicating, 
respectively,  the  least  preferred  scenario  and  the  most  preferred 
scenario.  The  actual  range  of  numbers  used  is  arbitrary  since 
they  are  always  standardized  during  the  analyBiB  step. 

Conduct  Mathematical  Analyals-«The  objective  of  the  mathe- 
matical analysis  is  to  determine  how  much  each  of  the  two  Issues 
contributes  to  the  preference  ranking.  Thus,  a participant's  pol- 
icy is  "captured"  mathematically  by  calculating  the  relative  im- 
portance (weights)  given  to  each  of  the  iseues.  A multiple  regres 
sion  equation  is  used  to  solve  for  the  coefficients  that  determine 
the  weightH.*  In  order  to  compare  the  weights  of  different  partic 
lpants,  It  is  necessary  to  standardize  all  the  numerical  values. 


A simplified  multiple  regression  fdr  this  example  is  shown  below. 
Y indicates  preference  and  Wj  and  V?2  indicate,  respectively,  the 
weights  for  national  economic  development  and  environmental  qual- 
ity, A detailed  mathematical  description  of  regression  analysis 
can  be  found  in  moat  math  texts. 

Y * W1  NED  + W2  EQ 
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Table  23  shows  the  standardized  values  and  relevant  equations 
used  In  the  multiple  regression  analysis. 

i 

Table  23 


STANDARDIZED  VALUES 


Issues 


Preferences 


nario 

NED 

-sa. 

Planner  A 

Planner  B 

1 

1.5 

1.5 

1.5 

2.6 

2 

1.0 

1.5 

1.5 

2.2 

3 

0.6 

0.7 

1.3 

1.0 

4 

0.1 

0.7 

1.0 

0.7 

5 

-0.2 

0.7 

0.2 

0.3 

6 

1.5 

0.2 

1.1 

0.3 

7 

-0.7 

1.1 

-0.1 

0.3 

8 

0.3 

0.2 

0.2 

0.1 

9 

-0.2 

-0.2 

-0.1 

0.2 

10 

-0.7 

-0.2 

-0.4 

-0.5 

11 

0.1 

-0.6 

-0.1 

-0.5 

12 

-1.0 

-0. 6 

-1.3 

-0.6 

13 

1.5 

-1.0 

0.6 

-0.6 

14 

0.6 

-1.0 

-0.2 

-0.6 

15 

-0.2 

-1.0 

-0.1 

1 

o 

16 

1.0 

-1.8 

-0.7 

-0.8 

17 

1 

O 

"4 

-1.4 

-1.5 

-0.7 

18 

-1.2 

-0.2 

-1.2 

-0.8 

19 

-1.5 

-0.2 

-1.3 

-0.8 

20 

-1.7 

1.5 

-1.2 

-0.7 

To  standardize  the  values  use  the  following  equation: 

Standard  Value  = - T.  Mean) 

Standard  Deviation 


For  example,  the  standardized  values  for  Scenario  1 
were  calculated  aB  follows: 

NED  =>  (20,000  - 11, 300)  /5, 948  = 1.5 
EQ  =»  (0.9  - 0.54) /0. 237  * 1.5 


Forecast  Preferences  and  Reaults--The  multiple  regression 
aolution  calculated  the  numerical  values  of  the  weights  for  each 
planner  as  follows: 


Planner 

A = 0.8  NED  + 0.5  EQ 

Planner 

B » 0.5  NED  + 0.7  EQ 

We lghts 

Issue 

Planner  A 

Planner  B 

NED 

0.8 

0.5 

EQ 

0.5 

0.7 

For  these  results  it  is  clear  that  Planner  A and  Planner  B have 
different,  In  fact,  almost  opposite,  policies  with  respect  to 
economics  and  environment.  While  both  planners  want  high  levels 
of  NED  and  EQ,  Planner  A indicates  a clear  preference  for  national 
economic  development  <0.8  to  0.5),  while  Planner  B prefers  environ- 
mental quality  even  at  the  risk  of  lower  GNP/family.  This  means 
that  they  have  opposite  viewpoints,  and  can  be  expected  to  support 
different  programs  whenever  there  is  a trade-off  between  economics 
and  environment.  However,  further  iterations  and  discussions  may 
lead  both  planners  to  agree  upon  some  level  of  economic  develop- 
ment for  a high  (say  0.6)  value  of  EQ. 

In  summary,  policy  capture  provides  a tool  to  determine  and 
quantify  where  differences  exist.  It  can  also  be  used  to  calcu- 
late and  evaluate  actual  trade-off  values  between  issues  (Crews, 
Johnson,  1974).  It  should  be  emphasised  that  this  1b  a numerical 
procedure  and  may  require  several  iterations  before  the  participants 
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are  comfortable  with  the  preference  weights.  In  other  words,  one 

must  make  sure  that  Planner  A really  prefers  economic  development  j 

twice  as  much  as  environmental  quality.  Also,  the  scenarios  pre-  I 

sented  in  this  example  are  hypothetical.  Once  the  weights  have  j 

been  refined,  the  user  should  review  his  options  or  actual  alter* 

natives  to  see  if  there  is  a compromise  plan  that  satisfies  both 

viewpoints.  For  example,  instead  of  a dam,  possibly  a channel 

system  would  maintain  the  desired  levels  of  development  and  envi* 

ronmental  quality.  Finally,  it  should  be  pointed  out  that  the 

policy  capture  procedure  requires  some  degree  of  skill  in  select-  I 

ing  the  issues  and  developing  the  acenarlos.  However,  skill  in  j 

i 

applying  the  procedure  can  be  readily  developed  and  the  mathemat-  j 

leal  procedures  are  straightforward  and  available  on  computer  j 

sya terns.  I 
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Section  V 

•. 'JALITATI.VE  AND  HOLISTIC 
FORECASTING  TECHNIQUES 


Introduction 


This  section  of  the  report  deals  with  forecasting  methods 
aimed  at  portraying  systems  holistically--that  is,  as  a whole. 

The  forecaster  typically  starts  with  an  intuitive  sense  of  the 
totality  instead  of  with  a specific  component  of  the  whole. 

Typical  holistic  characterisations  of  society  are  "good  times," 
"recession,"  sick  society,"  "imperialism,"  "achieving  society," 
"transformational  society,"  and  so  forth.  With  the  total  context 
in  mind,  the  planner  next  identifies  the  elements  and  how  they  fit 
together  to  make  the  whole,  the  driving  forces  of  change,  and  so 
forth.  At  this  stage  of  the  analysis,  such  methods  as  trend  ex- 
trapolation and  modeling  come  into  play  but  they  are  used  in  the 
service  of  explaining  the  whole.  This  kind  of  forecasting  thus 
tends  to  be  more  global,  more  qualitative,  and  "softer"  than  more 
conventional  approaches.  In  general,  these  are  the  least  devel- 
oped of  the  forecasting  techniques  discussed  in  the  Handbook. 
Without  doubt,  however,  they  represent  the  areas  where  the  most 
professional  attention  is  currently  being  paid.  In  the  opinion 
of  many,  qualitative  and  holistic  forecasting  techniques , are  the 
leading  edge  of  the  art  and  emerging  science  of  looking  ahead. 

The  specific  techniques  discussed  in  this  section  are  sce- 
narios and  related  methods,  expert-opinion  methods,  alternative 
futures,  and  values  forecasting. 
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SCENARIOS  AND  RELATED  METHODS 


Ceneral  Description 


Abstract 


This  section  discusses  scenario  and  related  forecasting  methods, 
including  modes  and  mechanisms  of  change,  authority  forecasting, 
surprise-free  futures,  and  scenarios.  It  is  emphasized  that  these 
methods  depend  upon  logical,  plausible,  and  imaginative  conjectures 
that  are  most  properly  regarded  as  descriptions  of  potential  fu- 
tures rather  than  as  probabilistic  forecasts  of  actual  futures. 

Such  methods,  like  all  other  qualitative  methods,  are  most  often 
used  in  conjecturing  about  complex,  little-understood  Bocial 
phenomena  for  which  more  rigorous  quantitative  forecasting  methods 
do  not  exist. 


Definitions 

Contrary  to  our  everyday  notions  (inherited  from  Descartes 
and  used  unthinkingly  by  all  of  us),  reality  is  not  some  fixed, 

I 

concrete  objective  existence  "out  there."  Rather,  reality  is  the 
picture  we  build  up  inside  our  headB  to  organize  and  explain  what 
William  James  aptly  called  the  "booming,  buzzing  confusion"  of  raw 
sensations  that  stimulate  us  incessantly.  Particular  understand- 
ings of  reality  are  determined  significantly  by  the  language  and 
culture  in  which  our  minds  develop.  For  example,  one  native  cul- 
ture near  the  Arctic  circle  recognizes  100  distinct  and  different 
types  of  snow,  while  in  a few  cultures  no  distinction  is  made  be- 
tween past  and  future,  only  between  "now"  and  "not-now." 
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The  notion  that  reality  as  we  may  understand  it  is  ona  of  an 
infinite  number  of  possible  cultural-linguistic  definitions  may 
be  difficult  to  comprehend,  and  unsettling  once  grasped.  The  hu- 
man mind  feels  an  urgent  need  to  believe  that  it  understands  how 
things  really  are:  what  things  do  actually  exist,  what  is  occur- 

ring, what  can  occur,  and  (in  consequence)  what  can  exist.  An 
insatiable  curiosity  and  an  incessant  drive  to  make  sense  out  of 
new  puzzles  when  we  become  aware  of  them  are  the  essence  of  being 
human . 

The  basis  of  modem  explanations  of  change  is  what  can  be 
called  cause-effect  reasoning.  The  premise  of  cause-effect  rea- 
soning is  that  whatever  happens  is  the  outcome  of  some  preceding 
occurrence  or  state  of  affr  If  only--so  goes  this  line  of 

reasoning--we  can  discover  une  cause,  we  can  explain  and  under- 
stand the  effect.  Indeed,  we  can  hope  by  understanding  the  cause 
to  foresee,  predict,  and  even  control  future  occurrences  by  manip- 
ulating or  regulating  causal  factors  in  the  present.  This  line  of 
thinking  inclines  the  analyst  to  examine  the  present  and  possible 
futures  in  terms  of  modes  and  mechanisms  of  change.  A mode  of 
change  is  simply  the  how  or  way  of  change.  A mechanism  of  change 
refers  to  the  means,  instrument,  or  mechanism  in  or  through  which 
a mode  of  change  is  expressed--an  airplane,  motor  vehicle,  ship,  or 
spacecraft,  for  example. 

In  attempting  to  forecast  the  future,  unfortunately,  many  of 
the  modes  and  mechanisms  of  change  are  tortuously  complex  and  ob- 
scure. Hence  forecasts  or  efforts  to  influence  the  actual  future 
based  on  complex,  obscure  modes  and  mechanisms  of  change  are  often 
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in  error.  When  we  must  rely  on  imperfect  understandings  of  how 
complex  modes  and  mechanisms  of  change  operate,  we  commonly  resort 
to  authority  forecasting.  Pronouncements  concerning  the  future  are 
easily  the  most  common  type  of  "forecast"  and  can  be  observed  dally 
In  every  arena  of  life. 

But  why  forecast  at  all  when  our  ability  to  foresee  the  future 
is  clearly  so  limited  and  inferior?  The  answer  is  that  we  must 
make  plans,  investments,  and  commitments  for  the  future  whether  or 
not  we  can  foresee  what  will  actually  occur.  We  therefore  must 
have  some  basis  for  making  current  decisions  for  dealing  with  the 
future.  One  common  way  of  proceeding  in  this  situation  is  to  as- 
sume for  planning  purposes  that  the  future  will  be  more  of  the 
same.  That  is,  we  can  assume  that  whatever  is  not  changing  today 
will  remain  stable  in  the  future.  And  we  can  assume  that  whatever 
is  changing  now  will  go  on  changing  at  about  current  rates  and  in 
the  same  direction. 

When  we  take  such  an  approach  we  are  using  what  Herman  Kahn 
and  Anthony  Wiener  (in  their  1967  book,  Toward  the  Year  2000) 
labeled  surprise-free  futures.  Such  futures  are  surprise-free 
not  in  the  sense  that  we  believe  they  represent  the  actual  future. 
Rather,  such  images  of  the  future  are  surprise-free  in  that  they 
assume  no  sudden  discontinuities  or  revolutions  that  would  make 
the  future  bear  little  resemblance  to  the  past  or  the  present. 

When  we  can  see  that  the  present  projected  into  the  future  may 
with  equal  plausibility  develop  in  two  or  more  different  directions, 
we  can  explore  each  direction  separately.  In  this  cbbc,  Kahn  and 
Wiener  would  aay  that  we  are  exploring  canonical  variations  on  the 
surprise-free  future. 
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But  how  can  we  express  or  put  down  in  an  organized  fashion 
our  conjectures  about  how  given  modes  and  mechanisms  of  change 
projected  into  the  future  might  result  in  particular  surpriae-f ree 
futures  or  variations  on  them?  One  of  the  most  commonly  used  tech- 
niques for  this  purpose  in  futures  forecasting  is  the  scenario. 

A scenario  is  nothing  more  than  an  outline  of  one  conceivable 
state  of  affairs,  given  certain  assumptions  about  the  present  and 
the  course  of  events  in  the  intervening  period.  The  term  scenario 
originally  referred  to  the  bare  outlines  of  a script  for  a film  or 
a stage  play.  As  used  in  the  futures  forecasting  field,  a scenario 
remains  essentially  a product  of  the  yarnspinner ' s art,  whether  the 
yarn  takes  the  form  of  narratives,  numerical  tables,  or  graphic 
projections.  It  is  important  to  note  that  scenarios  usually  are 
portraits  of  possible  futures  rather  than  predictions  of  what  will 
come  to  pass. 


A38umpt ions 

The  various  types  of  methods  mentioned  above  have  different 
underlying  assumptions.  For  example,  analysis  of  modes  and  mecha- 
nisms of  change  presumes  that  the  future  can,  in  fact,  be  foreseen 
in  these  terms.  The  authority  often  secretely  assumes  that  s/he, 
and  s/he  alone,1  knows.  The  basic  assumption  of  surpriife-free  tech- 
niques is  plain  from  the  name  itself.  Finally,  scenarios  are  prone 
to  be  written  by  people  who  sincerely  believe  they  can  imagine  the 
way  the  future  will  be--thts  despite  the  fact  that  all  previous 
forecasters  in  history  have  failed  to  foretell  the  emergence  of 
events  that  have  critically  shaped  the  future. 
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History 


Invocation  of  modes  and  mechanisms  of  change  to  explain  the 
present  and  foresee  the  future  is  as  old  as  human  thought  itself. 
Naturally  enough,  the  content,  power,  and  sophistication  of  modes 
and  mechanisms  drawn  upon  has  evolved  with  the  human  mind.  For 
example,  weather  forecasting  has  developed  from  the  simple-minded 
"red  in  the  morning  sailors  take  warning;  red  at  night,  sailor's 
delight"  to  the  use  of  elaborate  numerical  models  and  satellite 
photography. 

As  always,  development  of  Improved  modes  and  mechanisms  to 
explain  and  predict  change  has  progressed  more  rapidly  in  some 
fields  than  in  others.  Many  explanations  of  physical  changes, 

I 

for  example,  have  become  quite  powerful  and  reliable,  opening  the 
way  for  modern  physical  technology.  In  other  instances--notably 
in  the  fields  of  psychological  and  social  phenomena  where  the  need 
to  predict  and  control  is  great--explanations  and  understandings 
remain  limited.  It  is  for  that  reason  that  resort  to  authority 
forecasting,  as  already  mentioned,  remains  commonplace  today.  On 
the  other  hand,  it  is  precisely  because  even  the  "authorities"  are 
in  error  more  often  than  they  are  correct  that  the  search  for  im-‘ 
proved  explanatory  models  has  been  pressed  in  recent  years. 
Scenarios,  for  example,  aasume  that  the  actual  future  remains 
elusive  and  that  it  therefore  is  necessary  to  explore  a range  of 
potential  futures,  with  the  hope  that  the  actual  future  will  in 
some  sense  be  bracketed,  As  a formal  means  of  looking  ahead, 
scenarios  are  a product  of  the  1960s.  As  an  informal  means,  taking 
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such  forms  as  utopias,  dystopias,  and  much  science  fiction,  sce- 
narios go  back  to  the  days  of  Sir  Thomas  More  (1478-1535). 

Main  Uses 

The  limited  reliability  and  accuracy  of  scenario  and  related 
methods  to  predict  the  actual  future  have  been  emphasized  repeatedly. 
From  this,  it  follows  that  such  methods  are  normally  used  where  the 
need  to  conjecture  about  potential  futures  1b  thought  to  be  urgent 
and  Important  but  no  more  exact  methods  are  available.  Given  the 
present  and  future  importance  of  social,  economic,  and  political 
issues  and  the  status  of  the  behavioral  and  social  sciences,  it  is 
in  these  fields  that  scenario  methods  are  most  commonly  used. 
Scenarios  are  also  helpful  in  "freeing  up"  a planner's  conven- 
tional vision  of  reality.  Scenario  methods  can  be  and  have,  in 
fact,  been  used  in  other  applications--for  example,  in  technological 
forecasting--but  more  rigorous  methods  have  been  developed  for  such 
purposes,  and  they  are  preferable  whenever  their  use  is  feasible. 

Limits  and  Cautions 

In  the  presence  of  phenomena  that  intrigue  us  but  that  we  do 
not  understand,  we  humans  have  an  ancient  tradition  of  "making  up" 
plausible  explanations,  then  accepting  such  plausibilities  as 
truths.  The  scenario  writer--and  his  audience  as  well--is  ■l\  too 
apt  to  slip  into  what  dramatists  term  the  willing  suspension  of 
disbelief.  That  is,  we  are  apt  to  accept  "good"  stories  about  the 
future  as  forecasts  of  the  actual  future.  Symptomatic  of  this  is 
the  tendency  within  a set  of  scenarios  exploring  a range  of 
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potential  futures  to  look  for  the  one  that  is  the  real  forecast. 
Developers  and  users  of  scenario  methods  cannot  be  too  often  or 
too  strongly  cautioned  about  this  tempting  abuse  of  scenario 
methods.  The  other  side  of  this  coin  is  the  power  of  a negative 
scenario  to  sensitise  people  to  the  dangers  of  its  occurrence, 
Orwell's  1984,  for  example*  Is  less  likely  to  happen  because  of 
the  graphicness  of  the  scenario. 

Other  Techniques 

The  other  principal  techniques  for  future  forecasting  that 
are  most  interchangeable  with  scenario  methods  are  described  in 
subsequent  sections  of  this  Handbook.  They  are: 

• Expert-opinion  methods 

• Alternative  futures 

• Values  forecasting. 

Product  or  Result 

In  any  but  the  most  trivial  forecasting  effort  using  scenario 
and  related  techniques*  the  final  result  will  include  a formal 
document  recounting  topical  definition*  assumptions,  procedures, 
data  used*  findings,  and  interpretive  comments.  Depending  on 
which  combination  of  the  methods  discussed  here  is  used,  this 
document  will  cover  some  or  all  of  the  following  major  points: 

• Identification  and  discussion  of  the  major  modes 
and  mechanisms  of  change  invoked  and  applied  in 
making  the  forecast. 
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• The  credentials  of  the  authority  (or  authorities) 
whose  opinion  is  cited,  a statement  of  procedures 
followed,  information  used,  and  an  analytic  inter- 
pretation representing  the  authority's  best  judg- 
ment about  possibilities,  probabilities,  and 
crucial  factors. 

• A summary  or  a detailed  projection  of  what  the 
surprise-free  future  would  be  like,  together  with 
an  identification  and  at  least  some  treatment  of 
canonical  variations  on  the  surprise-free  future, 
if  any  of  major  importance  are  uncovered. 

• Any  or  ell  the  above  may  be  in  addition  to  01  in- 
corporated in  the  text  of  two  or  more  scenarios 
describing  plausible  potential  future  courses  of 
development  or  evolution  from  the  current  state  of 
affairs. 

It  perhaps  also  should  be  pointed  out  that  the  very  process 
of  imagining,  working  out,  and  discussing  scenarios  often  produces 
insights  and  sensitivities  at  leaBt  as  significant  to  the  planner 
as  the  more  concrete  outputs  from  the  exercise. 

i''  ■ 

Level  of  Detail 


Results  are  almost  always  broad  in  scenario-type  forecasts 
although  supporting  data  may  be  highly  detailed.  Authority  fore- 
casts are  more  likely  to  have  a narrow  focus  than  other  types  of 
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forecasting. 


Level  of  Confidence 

As  forecasts,  scenarios  should  command  little  respect  fox 
accuracy,  completeness,  or  validity  because  such  methods  are  used 
most  often  when  the  underlying  modes  and  mechanisms  of  change  are 


not  well,  understood.  As  useful,  logical,  and  plausible  conjectures, 
scenarios  can  be  evaluated  according  to  the  values,  insights,  and 
information  of  their  critics.  In  turn,  the  competence  and  qualifi- 
cations of  a given  critic  may  be  and  are  evaluated  on  precisely  the 
same  basis  by  other  critics. 

Communicability  of  Results 

Because  scenarios  can  be  expressed  in  the  form  of  coherent, 
plausible  stories,  they  constitute  perhaps  the  most  communicable 
form  of  futures  conjecture.  Indeed,  scenarios  are  frequently  ac- 
cepted as  forecasts  of  the  actual  futures  precisely  because  their 
reasoning  seems  so  logical  and  plausible,  while  the  use  of  rich 
typical  details  can  convey  the  "tang"  of  substantiality  that  often 
is  lacking  in  the  products  of  other  forecasting  methods. 

When  authority  forecasts  or  descriptions  of  surprise-free 
futures  are  presented  not  in  the  form  of  scenarios,  they  may  tend 
to  be  esoteric  and  jargon-filled,  and  hence  less  communicative 
than  scenarios. 


Credibility  of  Results 

The  credibility  of  the  results  of  scenario  and  related  methods 
varies  widely  from  topic  to  topic,  study  to  study,  and  audience 
to  audience.  When  the  method  is  essentially  that  of  authority 
forecasting,  the  authority's  credibility  may  be  extremely  high 
in  one  situation  and  extremely  low  in  another.  When  the  emphasis 
is  on  surprise-free  futures,  What  is  surprise-free  to  one  audience 
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may  be  shocking,  illogical,  and  totally  unacceptable  to  another — 
reflecting  differences  in  values,  assumptions,  and  knowledge.  As 
mentioned  repeatedly,  scenarios  are  often  given  more  credibility 
than  they  deserve,  because  of  their  powerful  literary  ability  to 
convey  an  (often  unwarranted)  sense  of  insight,  knowledge  and 
validity. 

Span  of  Forecasts  ■ 

The  future  time  horizon  of  scenario  and  related  methods  is 
wide  indeed.  These  methods  may  be  UBed  over  as  broad  a period  as 
assumptions,  data,  and  logical  plausibility  can  support.  Reflect- 
ing the  fact  that  these  methods  are  most  often  used  to  forecast 
complex  or  obscure  phenomena,  the  forecasts  tend  to  be  long  range-- 
five  years  and  more.  Scenario-type  methods  are  particularly  well 
adapted  to  looking  ahead  for  very  long  periods--say,  50  years  and 
more . 

Resources  Needed 

Like  most  qualitative  methods  discussed  in  this  section  of 
the  Handbook,  scenario  and  related  forecasting  methods  can  be  used 
with  fewer  resources  than  almost  any  other  forecasting  approach 
requires.  This  is  because  qualitative  methods  can  be  and  most 
often  are  used  not  to  predict  the  actual  or  most  probable  future 
but  rather  to  explore  a range  of  potential  futures.  So  used, 
scenario  methods  do  not  require  the  extent  or  quality  of  data  and 
analysis  needed  when  the  object  is  to  foresee  the  most  probable 
actual  future.  When  prediction  is  the  intent--especially  in  the 
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authority  method--resource  requirements  may  still  be  less  than 
for  other  methods,  or  they  may  be  comparable,  depending  primarily 
on  how  much  work  has  been  done  how  recently  by  others  tn  the  same 
or  In  closely  related  fields. 

On  the  other  hand,  these  kinds  of  methods  place  great  demands 
upon  the  analyst's  powers  of  imagination,  originality,  and  capacity 
to  break  free  of  conventional  assumptions  about  the  future.  In 
addition,  an  effective  scenario  writer  has  need  of  considerable 
literary  capacity. 

Procedures 

Anyone  gifted  with  an  imaginative  turn  of  mind  and  a sense 
of  how  events  fit  together  into  a whole --and  this  means  anyone 
free  enough  to  want  to  spin  stories  about  the  unknown--can  be  a 
scenariolst.  Easy  as  scenario-generation  is,  planners  conducting 
formal,  systematic  studies, will  want  procedural  help  from  experts. 
In  addition,  most  planners,  in  order  to  Introduce  as  firm  a data 
base  as  possible,  will  want  extensive  inputs  from  the  various 
publics  affected  as  well  as  from  specialists  in  the  trends  incor- 
porated into  the  scenario. 

Case  Example 

Scenarios  of  Future  Growth  Patterns 

Essentially  a story,  a scenario  may  be  developed  in  many  dif- 
ferent ways.  Most  approaches,  however,  involve  some  common  basic 
steps.  These  basic  steps  are  well  illustrated  in  an  imaginative 
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application  of  the  scenario  method  made  by  the  Corps'  Omaha  Dis- 
trict Regional  Planning  Branch.  The  four  scenarios  generated  are 
presented  in  a report  designed  for  the  widest  possible  dissemina- 
tion and  use  in  the  region.  Bearing  the  full  title  This  Land  is 
Your  Land,  it  will  for  brevity  be  cited  hereafter  simply  as  This 
Land  . . . . 

In  the  following  paragraphs,  we  list  eight  basic  steps  typi- 
cally taken  in  developing  any  scenario,  and  explain  each  step  in 
terms  of  This  Land  ...  as  an  actual  example. 

(1)  Identify  and  Describe  the  Users  and  the  Uses 
of  the  Scenarios 

This  Land  ...  identifies  the  cities  and  agencieB 
participating  in  the  Urban  Study  Program.  As  the  par- 
ticipants in  the  program  and  the  ultimate  plan  evolving 
from  it,  they  are  the  target  audience  for  the  scenarios. 
Among  the  many  parties  cited  in  This  Land  ...  are  the 
cities  of  Omaha,  Council  Bluffs,  and  Bellevue;  the 
Metropolitan  Area  Planning  Agency,  Iowa  Department  of 
Environmental  Quality;  the  Nebraska  Office  of  Planning 
and  Programming;  and  many  others. 


* 

THIS  LAND  IS  YOUR  LAND:  Water  resources  management  alternatives 
for  the  Omaha-Councll  Bluffs  area.  Introduction  and  Alternative 
Growth  Potentials  - Volume  1.  Omaha  District  Regional  Planning 
Branch,  U.S.  Army  Corps  of  Engineers,  6014  U.S.  Post  Office  and 
Court  House,  215  North  17th  Street,  Omaha,  Nebraska  68102,  1975, 
20  pages. 


In  Phase  I of  the  Study  Program,  factors  affect- 
ing the  region's  water  and  water-related  land  resources 
were  Investigated  in  depth.  Pertinent  concerns,  oppor- 
tunities, and  constraints  bearing  on  potential  solu- 
tions were  also  examined  carefully. 


Phase  II  involved  developing  the  alternative  scenarios 
presented  In  This  Land  ....  While  the  scenarios  In  this 
study  were  limited  to  exploring  alternative  patterns  of 
future  growth  in  the  region,  subsequent  sets  of  scenarios 
deal  with  waste  water,  water  quality  management,  water 
supply  management,  water-related  recreation,  flood  con- 
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trol/flood  plain  management,  and  water  and  water-related 
land  resources. 


(2)  Select  a Time  Horlson  Suitable  to  Project  Requirements 


In  this  instance,  the  time  horizon  had  been  pre- 
viously selected  for  the  Urban  Study  Program  overall, 
namely  the  period  1970-2020. 


(3)  Select  a Territorial  Scope  Suitable  to  Project 


Here,  again,  the  boundaries  of  concern  had  already 
been  established  by  the  program.  They  include  Washing- 
ton, Doubles,  Sarpy,  and  Cass  counties  in  Nebraska; 
and  Harrison,  Pottawattamie,  and  Mills  counties  in 
Iowa, 
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(4)  Select  Critical  Iasues  to  be  Treated  In  the  Scenarios 


Once  again,  these  issues  had  already  been  selected 
in  Phase  I of  the  program,  and  were  listed  above  in 

t 

Step  1,  Once  again,  the  reader  is  reminded  that  This 
Land  ...  scenarios  were  limited  to  exploring  future 
growth  alternatives.  Other  sets  of  scenarios  were 
scheduled  in  turn  to  deal  with  each  of  the  major 
issues  mentioned  earlier. 

(5)  Select  Basic  Topics  to  Be  Treated  in  the  Scenarios 

This  Land  ...  singled  out  the  following  topics  for 
attention: 

(a)  Possible  social  and  economic  trends  in 
the  nation  and  the  Midwest  as  applicable 
to  the  study  area. 

(b)  Alternative  forms  of  future  urban  growth 
discussed  in  studies  of  other,  comparable 
metropolitan  areas. 

(c)  The  expressed  goal  aspirations  of  citizens, 
organizations,  and  planners  throughout 

the  study  region. 

(6)  Compile  and  Organize  a Data  and  Information  Base 
to  Be  Used  In  Developing  the  Scenarios 

Phase  1 of  the  Urban  Study  Program  had  already  devel- 
oped the  data  and  information  base  required  to  write  the 
scenarios.  In  this  case,  the  necessary  investigation 
had  been  done  under  contract  by  Dana  College,  Blair, 
Nebraska, 
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(7)  Determine  the  Scenarios  to  Be  Developed; 

Write  and  Circulate  Review  Drafta 

The  following  four  ecenerioe  were  developed  for 
This  Land  . . . ; 

i 

Growth  Concept  A--ProJectlon  of  current  land- 
uee  trends  in  the  region. 

Growth  Concept  B --Controlled  expansion  of  urban 
Omaha,  with  emphasis  on  higher  density  residential 
development,  revitalization  of  the  urban  core,  and 
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development  of  eatellite  cities. 

Growth  Ooncept  C--Simllar  to  Growth  Concept  B, 
except  for  the  omission  of  satellite  city  development. 

Growth  Concept  D- "Similar  to  Growth  Cohbept  A, 
except  for  the  assumption  that  much  development  will 
occur  in  fingerlike  projections  along  the  major  trans- 
portation corridors. 

In  draft  form,  these  scenarios  were  circulated,  re- 
viewed, and  critiqued  by  appropriate  committees  and 
others  representing  Urban  Study  Program  participants. 
Final  revisions  were  made  by  the  project  team  and  the 
excellent  report,  This  Land  ...  was  published. 

(8)  Distribute  the  Scenarios  to  All  Users 

This  Land  ...  has  been  widely  dl» tributed  to  cities, 
agencies,  organizations,  and  private  citizens  throughout 
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the  region.  All  recipients  have  been  invited  to  express 
their  preferences  among  the  four  alternative  growth 
concepts  presented,  and  told  how  to  register  their 
preferences  with  the'  project  team.  Apart  from  in- 
dividual expressions  of  opinion,  This  Land  ...  also 
affords  an  excellent,  readily  usable  vehicle  for  work- 
shops and  other  organized  solicitations  of  opinion  from 
Interested  groups  throughout  the  region. 


EXPERT-OPINION  METHODS 


General  Description 


Abstract 


Thli  section  discusses  forecasting  via  expert-opinion  methods, 
Including  the  use  of  panels,  surveys  of  intentions  and  attitudes, 
and  Delphi  polls.  It  Is  emphasized  that  the  definition  of  exper- 
tise as  well  as  the  limits  to  Its  use  for  forecasting  purposes  can 
be  considered  In  terms  of  three  aspects:  topic,  sponsor,  and  other 

eventual  users  of  the  study's  end-product.  Expert-opinion  methods 
may  be  used  either  for  actual  forecasts  or  to  make  conjectural  ex- 
plorations of  potential  futures.  Identifying,  qualifying,  and  mak- 
ing  pertinent  experts  credible  is  a central  Issue  with  theee 
methods.  While  the  findings  of  expert-opinion  studies  are  usu- 
ally easy  to  communicate,  it  is  often  difficult  to  convey  the 
specialized  information  and  the  reasoning  on  which  findings  are 
based.  \ 


Definition 

Expertise  must  surely  be  among  the  service  commodities  most 
widely  and  variously  bought  and  sold  in  contemporary  society. 
Ranging  all  the  way  from  advice  on  how  to  grow  earthworms  at  home 
for  profit  to  a consultant  firm's  reorganization  of  the  Bank  of 
England,  expert  opinion  and  advice  is  an  essential  lubricant, 
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Granted  that  expert  opinion  is  both  essential  and  pervasive 
in  modern  times,  it  may  seem  surprising  that  insights  into  the 
nature  and  proper  uses  of  expertise  remain  In  such  a primitive 
state . 

One  simple  way  to  clarify  the  nature  of  expertise  is  to  in- 
quire: expertise  relative  to  what?  A simple,  three-way  breakout 

in  answer  to  the  question  sheds  some  useful  light.  Expert  opinion 
may  be  defined  and  assessed  relative  to: 

• Its  topical  object 

• The  sponsors  of  expert-opinion  studies 

• The  end-users  of  expert-opinion  studies. 

The  supply  and  accuracy  of  expert  opinion  relative  to  any 
given  topic  increases  as  the  topical  scope  narrows,  topical  com- 
plexity decreases,  and  well-understood  principles  and  theories  can 
can  be  invoked.  By  the  same  token,  the  supply  and  accuracy  of 
expertise  decreases  as  these  aspects  of  a topic  shift  in  the  oppo- 
site directions.  It  is  clear,  for  example,  that  far  fewer  people 
are  able  to  make  reliable  forecasts  for  the  50-year  future  of  sur- 
face transportation  in  the  United  States  than  can  usefully  predict 
future  trends  in,  say,  the  narrower  segment  of  barge  traffic. 

One  means  of  assessing  the  supply  and  worth  (assuming  that 
worth  and  accuracy  of  forecast  are  positively  related)  of  expert 
opinion  about  the  future,  then,  is  to  relate  it  to  the  scope,  com- 
plexity, and  theoretical  foundations  of  the  topic.  A different, 
second  route  to  the  same  end  is  to  assess  expertise  by  contrasting 
it  with  the  worldviews  and  intents  of  whomever  is  willing  to  buy 
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and  pay  for  auch  opinion.  The  future  of  automotive  technology 
can  serve  as  an  illustration  of  this  point. 

If  an  automobile  manufacturer  in  sponsoring  a forecast  of 
automotive  technology  for  the  next  50  years,  certain  types  of  ex- 
pertise and  certain  experts  will  be  held  pertinent,  competent,  and 
credible.  If  the  same  study  were  to  be  sponsored  by  the  National 
Academy  of  Engineering,  the  Office  of  Technology  Assessment,  Common 
Cause,  or  the  Sierra  Club,  the  expertise  judged  relevant  would  be 
the  same  in  certain  instances  and  different  in  others.  The  spon- 
sor's experience,  understanding,  and  motives  significantly  affect 
what  expertise  is  held  important. 

In  addition  to  the  specificity  of  a topic  and  the  character 
of  a sponsor,  the  identity  of  the  eventual  forecast  end-user 
(specific  publics  in  the  case  of  Corps  projects)  influences  who 
is  considered  expert.  This  third  aspect  of  the  matter  actually 
is  implied  in  the  preceding  paragraph.  In  framing  legislation 
pertinent  to  automotive  technology,  Congress  has  purposes  and  re- 
quirements substantially  different  from  those  of  auto  manufac- 
turers in  planning  its  research  program  for  the  years  ahead.  Oil 
companies,  companies  proposing  alternative  propulsion  systems,  and 
conservationist  groups  have  still  other  motives. 

Thus,  before  one  can  answer  the  deceptively  simple  question, 
Who  is  Expert,  the  questions  of  forecast  topic,  sponsor,  and  end- 
user  must  be  addressed  in  each  particular  Instance.  Because  these 
three  different  perspectives  are  seldom  identical,  consensus  on 
the  pertinence,  competence,  and  credibility  of  experts  to  be  con- 
sulted is  seldom  if  ever  attained.  Organisations  desiring  to 

208 


employ  expert-opinion  forecasting  methods  should  be  forewarned 
of  the  issues  raised  here,  and  should  make  specific  provisions  in 
advance  for  dealing  with  them. 

Given  such  general  comments  about  expert-opinion  methods, 
three  specific  methods  of  this  type  are  discussed  in  this  section. 

Panels  are  selected,  organized  groups  of  persons  thought  to 
have  in  common  an  exceptional  degree  of  expert  knowledge  or  opinion 
about  some  designated  topic.  Panels  may  be  informal,  ad  hoc,  one- 
time-only groups  meeting  face-to-face  to  hammer  out  a consensus. 
Many  other  variations  are  possible,  including  extremely  formal, 
continuing  groups  which--as  in  Delphi  panels— may  never  meet  face- 
to-face. 


Surveys  of  Intentions  and  Attitudes  represent  one  specific 


application  of  opinion  polling  or  survey  research  techniques. 

Such  surveys  seek  to  clarify  the  opinions  within  a specified 
population  concerning  its  priorities  or  Intended  future  behavior. 

In  this  Instance,  the  people  involved  are  regarded  as  the  only 
experts  on  their  own  attitudes  and  intents,  Surveys  can,  of  course 
deal  with  national  samples,  various  subsamples,  international  opin- 
ion, and  so  forth. 

Delphi  Polling  and  related  methods  are  another  specific  ap- 
plication of  opinion  polling  and  survey  research  methods.  In  this 
technique  participants  do  not  meet  and  are  not  identified  until  the 
poll  has  been  completed,  so  as  to  minimize  the  influence  of  "big 
names"  and  dominant  personalities.  The  use  of  mail  removes  limi- 
tations of  geography  in  selecting  panelists.  In  Delphi  polls, 


expertise  may  be  equated  with  special  knowledge  about  a topic,  in- 
formed opinions  about  the  attitudes  and  Intents  of  some  population, 
or  both.  Unlike  surveys  of  intentions  and  attitudes,  in  Delphi  , 
polls  individual  participants  are  given  one  or  more  opportunities 
during  the  study  to  compare  and  (if  s/he  chooses)  revise  her/his 
estimates.  Typically,  Delphi  polls  involve  far  fewer  participants 
than  public  surveys,  partly  because  of  the  greater  demands  made  on 
Delphi  participants  and  partly  because  of  the  greater  complexity 
and  cost  of  Delphi  studies. 


As  implied  by  the  preceding  disucssion,  the  primary  assump- 
tions on  which  expert- op inion  methods  are  based  include  that: 

• The  forecast  topic  can  be  delineated  in  sufficient 
detail  to  make  possible  the  identification  of  perti- 
nent experts. 

• The  nature  of  the  topic  is  such  that  persons  whose 
knowledge  and  experience  are  especially  pertinent 
to  the  topic  are  better  able  than  others  to  predict 
the  probable  future  course  of  developments. 

• A representative  sample  of  qualified  experts  can  be 
tapped  to  participate  in  the  forecast  or  study. 

• The  qualifications  of  the  experts  selected  will  be 
accepted  both  by  the  sponsors  and  by  the  ultimate 
UBers  of  the  forecast,  when  these  parties  are  not 
the  same . 
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History 

Rousseau  once  observed  sarcastically  that  "the  first  priest 
was  the  first  rogue  who  met  the  first  fool."  Given  the  vague, 
subjective  nature  of  expertise  and  the  universal  human  need  to 
minimize  uncertainty,  one  might  substitute  expert  for  priest  in 
Rosseau's  aphorism.  In  any  case,  kings,  generals,  and  powerful 
persons  of  all  descriptions  have  always  relied  on  trusted  advisors 
presumed  to  be  experts  in  their  respective  fields.  Today,  corre- 
sponding roles  are  played  by  corporate  and  government  agency  staffs, 
academics,  research  organisations,  and  consultants  of  every 
description.  Resort  to  panels  and  Delphi  polls  as  explicit, 
specialized  methods  are  of  more  recent  vintage.  The  use  of  con- 
sumer panels  to  pretest  products  and  the  use  of  panel  discussions 
at  meetingj,  conventions,  and  colloquia  are  essentially  develop- 
ments of  the  20th  century.  Opinion  polling  and  survey  research 
have  their  modern  origins  in  the  rise  of  mass  communication  media, 
the  interest  of  politicians  in  popularity  ratings,  and  the  rise  of 
mas9  national  markets  associated  with  the  post  World-War-1  era. 
Delphi  polling,  as  p distinctive  application  of  survey  research 
methods,  was  developed  and  first  used  for  the  Department  of  Defense 
by  the  RAND  Corporation  in  the  1950b. 

Main  Uses 

The  main  uses  of  expert-opinion  forecasting  methods  are  con- 
veniently subdivided  into  two  types.  In  one  type,  the  experts 
consulted  'are  r/j?ftuited  because  of  their  extensive  special  knowl- 
edge about  a topic.  Examples  would  be  a panel  forecast  of  the 
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prospects  for  nuclear  fusion  power,  or  a Delphi  forecast  of  eco- 
nomic growth  using  selected  econometricians  sb  participants. 

Subject  matter  in  these  kinds  of  studies  ranges  from  the  broad  to 
the  highly  specific  and  narrow. 

In  the  second  type,  participants  are  recruited  because  they 
are  deemed  representative  of  a subpopulation  whose  opinions  or 
intentions  for  the  future  constitute  (or  Influence)  the  forecast 
topic.  Examples  would  include  presidential-preference  opinion 
polls  or  the  widely  respected  surveys  of  consumer  spending  inten- 
tions conducted  regularly  by  several  organizations.  As  a rule, 
specifically  technical  questions  are  not  included  in  public  opinion 
studies,  but,  otherwise  topics  can  range  from  the  global  to  a pin- 
point issue. 

Limits  and  Cautions 

When  introducing  the  definitions  of  expert-opinion  methods, 
we  suggested  that  expertise  can  be  characterized  relative  to  a 
study  topic,  study  sponsor,  and  end-product  users.  Limits  and 
cautions  to  these  methods  are  conveniently  considered  under  the 
same  headings. 

Perhaps  the  most  difficult  and  least  appreciated  aspect  of 
these  methods  is  the  problem  of  defining  appropriate  topics  to 
forecast.  No  matter  what  method  is  used,  the  final  results  will 
have  a limited  value  if  the  topic  was  inadequately  defined  at  the 
outset.  In  expert-opinion  methods,  the  importance  of  adequate 
topic  definition  is  particularly  crucial,  not  only  because  the 
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identity  and  pertinence  of  experts  to  be  consulted  hlngeB  on  the 
definition,  but  because  one  needs  to  be  certain  that  the  experts 
share  the  same  notion  of  what  they  are  forecasting. 

Sponsors  organizing  an  expert-opinion  futures  study  should 
take  special  care  to  define  and  program  two  items;  how  the  end- 
product  is  to  be  used,  and  how  it  is  to  be  assessed.  Expert  opinion 
can  be  expensive,  and  it  is  foolish  to  implement  a substantial  study 
before  ^t  can  be  shown  who  is  going  to  make  what  uBe  of  the  result 
to  what  end  when  the  study  is  completed.  By  the  same  token,  ob- 
jective criteria  for  weighting  the  study  findings  and  implementing 
their  implications  should  be  thought  through  before  the  study  be- 
gins. Otherwise,  an  unanticipated  conclusion  may  become  a source 
of  endless  wrangling  and  delay.  If  there  is  any  reason  to  suppose 
that  knowledge  of  the  name  of  the  sponsor  would  skew  responses  of 
the  experts,  the  sponsor's  identity  should  remain  secret  until  the 
poll  is  completed. 

If  an  expert-opinion  study  is  to  be  available  to  or  used  by 
parties  other  than  its  immediate  sponsor,  it  is  essential  to  de- 
fine the  purpose  (s)  of  the  study  from  the  start  so  as  to  avoid 
misunderstandings  and  disappointments.  For  example,  a study  may 
have  as  its  object  an  exploration  of  potentials,  a probabilistic 
forecast  of  the  expected  future,  or  some  combination  of  the  two. 

A study  intended  to  serve  as  a forecast  must  meet  more  rigorous 
standards  than  a merely  exploratory  study.  On  what  basis  was  the 
particular  method  used  selected?  How  were  experts  identified  and 
assessed?  What  criteria  lor  content  and  credibility  will  the  fore- 
cast's intended  audience  insist  upon?  These  and  related  issues 
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must  be  raised  and  resolved  before  the  project  begins,  and  not 
when  the  forecast  findings  are  challenged  after  the  fact. 

Other  Techniques 

The  other  principal  techniques  for  futures  forecasting  that 
are  most  interchangeable  with  expert-opinion  methods  are  the 
allied  holistic  forecasting  methoda--scenarios  and  alternative 
futures. 

Product  or  Result 

The  scope,  formality,  and  effort-level  of  expert-opinion 
forecasting  methods  vary  enormously,  and  the  end-product  or  result 
varies  accordingly.  The  result  may  amount  to  little  more  than  a 
25-word  oral  reply  to  a casual  inquiry  made  of  an  expert  in  the 
course  of  Borne  other  Interaction  with  a client.  At  the  other  ex- 
treme, a major,  Intensive  Delphi  study  might  yield  a 200  to  300 
page  final  report,  including  raw  data  for  each  round,  elaborate 
statistical  analysis,  and  many  pages  of  Interpretive  comments. 

Level  of  Detail 

As  indicated  above,  detail  in  these  kinds  of  forecasts  can 
range  from  unsupported  conclusion  to  elaborate  statistical  analysis. 

Level  of  Confidence 

The  range  of  confidence  is  great.  It  depends  not  only  on 
the  nature  of  the  topic  and  available  experts,  but  on  whether  the 
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kinds  of  considerations  sketched  above  In  "Limits  and  Cautions" 
are  taken  into  proper  account. 

Conmunleabll ltv  of  Results 

The  communication  of  expert  opinion  Is  perhaps  one  of  the 
most  controversial  topics  in  modern  society.  Complexity  and 
specialization  combine  to  create  a situation  in  which  the  more 
expert  an  opinion  is  the  less  intelligible  it  becomes  to  others. 
In  expert-opinion  forecasts  or  studies,  the  findings  and  conclu- 
sions usually  can  be  conveyed  well  enough.  On  the  other  hand, 
the  information  and  the  reasoning  on  which  the  findings  and  con- 
clusions are  based  may  be  essentially  incommunicable.  Whenever 
a study's  findings  are  unpleasant  or  inconvenient,  a stage  is  set 
for  endlesB  debate  and  dispute  about  the  validity  of  the  study. 

Credibility  of  Results 

This  aspect  of  expert-opinion  forecasting  is  sufficiently 
discussed  above  in  "Definition"  and  in  "Limits  and  Cautions." 

The  key  question  is,  Credible  to  whom? 


Span  of  Forecasts 

A forecast  or  futures  study  based  on  expert  opinion  may  em- 


brace any  time  span  an  acknowledged  expert  is  willing  to  treat 
and  a sponsor  finds  credible.  Speaking  practically,  however,  time 
spans  are  determined  by  the  topic  and  by  the  minimum  interval  re- 
quired for  significant  changes  to  be  experienced.  For  example, 
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an  expert-opinion  forecast  of  future  automotive  technology  might 
embrace  a time  span  of  the  next  10  to  30  years.  By  contrast)  sur- 
veys of  consumer  buying  intentions  typically  range  between  the 
next  few  months  and  the  next  year.  Or  again)  forecasts  treating 
the  future  of  societal  institutions  may  consider  prospects  for 
the  next  few  generations. 

Resources  Needed 

Like  other  qualitative  methods,  the  scope,  sophistication, 
and  so  the  cost  of  expert-opinion  studies  vary  widely  from  one 
situation  to  another.  Where  a single  expert  is  asked  to  provide 
a casual  estimate  of  limited  scope,  a minute  of  time  and  little 
or  no  cost  may  be  involved.  Where  a substantial  panel,  polling, 
or  survey  is  required,  costs  totaling  $10,000  to  $50,000  or  even 
more  may  be  sustained.  Typically,  significant  opinion  or  Delphi 
studies  require  several  months  to  plan,  implement,  and  analyze. 

Major  polling  efforts  require  researchers  familiar  with  ques- 
tionnaire and  survey  design  plus  basic  statistics.  Survey  results 
are  often  computerized  for  ease  of  manipulation.  The  Delphi 
procedure  Involves  much  clerical  and  paper  work  and  careful  at- 
tention to  exact  phrasing  ar.d  rephrasing  of  responses  of  panelists. 

Procedures 

As  in  scenario  techniques,  the  planner's  need  for  expert 
assistance  ranges  from  essentially  none  (if  s/he  is  the  expert! 
to  extensive,  if  numerous  trends  are  involved.  With  respect  to 
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procedures,  this  situation  is  similar:  simple  panel  procedures 

are  familiar  to  everyone;  in  contrast,  it  would  be  foolhardy  for 
an  inexperienced  planner  to  attempt  a major  Delphi  Btudy  without 
expert  guidance. 

Two  illustrations  of  expert-opinion  procedures  are  given 
below.  The  first  describes  an  extensive  Delphi  study  and  the 
second  a hypothetical  "mini-Delphi"  procedure  that  could  be  use- 
ful in  a conference  setting. 


Case  Examples 

The  AWR  Delphi  Study 

A Delphi  poll  on  the  future  of  American  Water  Resource  (AWR) 
utilization  and  development  was  conducted  during  1972  for  the 
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Institute  for  Water  Resources.  For  brevity,  we  shall  hereafter 
refer  to  this  study  simply  as  the  AWR  Delphi.  This  example  of  a 
Delphi  poll  is  discussed  in  terms  of  a sequence  of  seven  baBlc 
steps  common  to  most  Delphi  studies.  These  steps  are: 

• Identify  and  describe  users  and  uses  of  the  Delphi 
poll  results. 

• Select  topics  or  issues  for  study. 

• Recruit  qualified  participants  for  Delphi  poll. 


Report  of  Delphi  Inquiry  Into  the  Future  of  American  Water 
Resource  Utilization  and  Development.  Minneapolis:  Office 

for  Applied  Social  Science  and  the  Future,  University  of  Min- 
nesota. January  15,  1973,  56  pages  plus  two  extensive  appendix 
volumes . 
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• Prepare  and  mail  Round  One  Questionnaire. 

• Analyse  Round  One  returns,  and  prepare  and  mail 
Round  Two. 

• Analyze  Round  Two  returns,  and  prepare  and  mail 
Round  Three. 

• Analyze  Round  Three  results  and  prepare  final 
report. 

In  describing  the  AWR  Delphi,  actual  findings  are  referred 
to  only  to  the  extent  necessary  to  make  clear  the  procedures  fol- 
lowed. Readers  interested  in  the  substantive  outcomes  of  the  AWR 
Delphi  are  referred  to  the  final  report,  already  cited. 

Identify  and  Describe  Users  and  Uaes--The  ultimate  users 
intended  by  IWR  in  sponsoring  the  AWR  Delphi  included  all  Corps 
organizations  and  individuals  concerned  with  water  resources  plan- 
ning, together  with  their  consultants,  contractors,  client  govern- 
ments, and  coordinate  organizations  such  as  Department  of  Interior 
and  Bureau  of  Reclamation. 

The  intended  use  was  for  background,  exploratory  study  pur- 
poses. Corps  projects  in  recent  years  have  regularly  encountered 
sudden,  unanticipated  delays  and  opposition.  Believing  that  a 
substantial  factor  behind  these  difficulties  was  a difference  in 
values  and  preferences  among  various  stakeholders,  IWR  hoped  that 
the  AWR  Delphi  might  shed  some  useful  if  tentative  light  on  this 
important  topic.  Such  insights,  in  turn,  would  be  of  immediate 
practical  value  in  ongoing  water  resources  project  planning, 
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Select  Topics  or  Issues  for  Studv--The  AWR  Delphi  focueed  on 
the  Interrelations  and  Interactions  between  two  broad  topics: 
American  values,  value  differences,  and  value  changes  on  the  one 
hand,  and  present  and  future  water  resources  problems  on  the  other 

A register  of  American  values  prepared  in  earlier  work  by 
Baler  and  Rescher  (1969)  was  used  in  designing  value  questions 
for  the  Delphi  poll.  In  all,  42  important  American  social  values 
were  included,  organised  under  six  main  headings:  (1)  oneself, 

(2)  one's  group,  (3)  society,  (4)  the  nation,  (S)  all  mankind, 
and  (6)  the  environment.  As  an  illustrative  example,  the  values 
listed  under  Oneself  included  personal  material  welfare,  self- 
respect,  self-reliance,  personal  liberty,  self-advancement,  self- 
fulfillment,  and  skill  and  prowess. 

In  turn,  each  of  chess  individual  value  items  was  character- 
ised in  a few  words.  For  instance,  self-respect  was  characterised 
as:  "the  right  to  be  treated  as  a person  and  as  a member  in  good 
standing  of  the  community;  honor,  honorableness."  In  a few  cases, 
even  these  individual  value  items  were  further  subdivided. 

American  values  was  one  of  two  broad  topics  explored  in  the 
AWR  Delphi,  the  other  being  water  resource  problems.  For  this 
second  topic,  a different  approach  was  taken.  Rather  than  using 
an  exhaustive  typology  of  water  resources  problems,  the  AWR  Delphi 
project  team  singled  out  seven  individual  problems  judged  to  be 
of  special  importance.  The  seven  problems  cited  were: 
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(1)  Demand  for  and  abuse  of  water  resources  resulting 
from  increasing  affluence. 

(2)  Demands  on  water  resources  resulting  from  energy 
consumption. 

(3)  The  relative  rights  and  responsibilities  of 
federal,  regional,  state,  and  local  authorities, 
and  public  and  private  interest  groups  in  planning 
and  managing  water  resources. 

(4)  Public  confidence  in  officials  (including  tech- 
nical specialists)  and  in  the  information  they 
provide,  regarding  planning,  managing,  and  using 
water  resources. 

(5)  Demand  for  waterborne  transportation  requiring 
additional  port  facilities  that  encroach  upon  and 
pollute  water  and  contiguous  land  resources  that 
otherwise  could  be  devoted  to  wilderness,  recrea- 
tion, aesthetic,  and  other  uses. 

(6)  Reduction  in  the  availability  of  beaches  and  shore- 
lines due  to  erosion  or  private  use,  or  both. 

(7)  Population  mobility  and  consequent  public 
apathy  toward  water  resources  decisions  of 
the  community. 

Recruit  Qualified  Partlclpants--In  making  a Delphi  futures 
study  of  the  evolving  relations  between  two  such  broad  topics, 
rigorous  and  clear-cut  definition  of  qualified  participants  was 
difficult.  This  1b  a problem  regularly  encountered  in  using  the 
Delphi  poll  method  for  topics  other  than  those  whose  scope  can  be 
narrowly  and  rigorously  defined,  After  due  consideration,  the 
AWR  Delphi  project  team  adopted  the  following  definition  of  quali- 
fied participants:  "Persons  whose  occupations  and  activities  seem 

likely  to  influence  the  future  development  and  utilization  of  water 
resources,  as  well  as  those  more  conventionally  acknowledged  to  be 
specialists  in  the  field," 
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Drawing  on  their  reapeotive  knowledge  and  experience,  the 
project  team  members  developed  a liet  of  280  potential  partici- 
pants  in  the  AWR  Delphi,  and  invitations  were  extended.  In  due 
course,  124  persons  agreed  to  participate,  the  others  declining 
for  a variety  of  reasons. 

* 

(As  a side  note,  participants  in  the  AWR  Delphi  were  not 
remunerated  for  their  services.  ThiB  is  a standing  issue  in 
using  the  method.  Some  parties  contend  that  remuneration  invar- 
iably distorts  the  sampling  of  experts  involved,  while  others  argue 
that  it  is  unrealistic  and  unfair  to  require  extensive  effort  from 
well-qualified  specialists  without  compensation.  In  general, 
participants  are  often  willing  to  serve  without  compensation  if 
the  issue  is  of  public  significance  or  if  their  personal  interests 
are  affected;  compensation  is  usually  expected  if  the  work  is  for 
the  benefit  of  a profit-making  enterprise.) 

Proceeding  slightly  out  of  sequence  for  a moment,  biographic 
data  about  the  124  participants  were  gathered  in  Round  One,  Three 
Judges  independently  then  categorized  each  participant.  In  this 
way,  a list  of  categories  of  participants  was  devised  and  applied 
in  all  three  rounds  of  the  AWR  Delphi,  enabling  the  project  team 
to  track  any  shifts  in  the  composition  of  participants,  round  by 
round.  Seven  categories  were  used: 

• General  academics 

• Water  resource  academics 

• General  government  representatives 

• Water  resource  government  representatives 
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• Commercial  representatives 

• Private  and  public  Interest  group  representa- 
tives! including  individual  private  citizens 

• Consultants 


Prepare  and  Mall  Round  One  Questionnaire --Round  One  wsb 
limited  to  exploring  the  register  of  American  values  already 
described.  With  subdivisions  in  some  cases,  42  values  comprising 
72  items  were  provided!  for  each  of  which  participants  were  asked 
to  give  forecast  estimates.  (As  mentioned  earlier,  biographic 
data  on  the  participants  was  also  gathered  with  the  Round  One 
Questionnaire.)  Item  1 on  the  Round  One  Questionnaire,  together 
with  the  reply  column  headings,  is  reproduced  in  the  tabulation 
below. 


(check  one  column  for  each  item) 

Probably  Probably  Probably  No 

leas  im-  more  im-  same  im-  Answer 

portant  portent  portance 

than  to-  than  to-  as  today 

day day 

Self-oriented  values 

1.  Personal  material 
welfare  (the  right 
to  life  and  the 
pursuit  of  happi- 
ness) 

A.  Health  (phy- 
sical and 
mental  well- 
being) ______  ______  _____ 
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Following  prescribed  Delphi  procedure,  the  72-item  ballot 
was  mailed  to  the  124  persona  who  had  agreed  to  participate  in 
the  AWR  Delphi.  In  due  course,  100  usable  Round  One  Question- 
naires were  returned  to  the  project  team. 

Analyse  Round  One  Returns  and  Prepare  and  Mall  Round  Two-- 
Compared  with  Rounds  'Two  and  Three,  assessment  of  the  100  Round 
One  Questionnaires  returned  was  relatively  simple.  The  task  was 
to  estimate  the  nature  and  extent  of  agreement  among  the  partici- 
pants as  to  probable  future  changes  in  American  value  priorities. 
Index  values  were  assigned  to  the  individual  reply  columns  as 
follows: 

Probably  less  (-1) ; probably  same  (0);  and  probably  more  (+1). 
These  index  values  for  each  item  were  then  added  together  and 
divided  by  the  number  of  replies  to  arrive  at  a change  index 
value  for  the  item. 

Next,  the  range  of  change  index  values  was  itself  divided 
into  seven  intervals,  and  an  interpretative  significance  assigned 
to  each  interval,  as  shown  below: 


A change  index  of: 


+0.5  and 
-0.5  and 
+0.35  to 
*0,35  to 
+0,25  to 
-0.25  to 
-0.24  to 


greater 

smaller 

+0.49 

-0.49 

+0.34 

-0.34 

+0.24 


Is  interpreted  as  meaning: 

Significant  positive  change 
Significant  negative  change 
Probable  positive  change 
Probable  negative  change 
Possible  positive  change 
Possible  negative  change 
Significant  change  not  likely 
(il  at  least  half  of  all  replies 
were  "probably  same") 
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For  16  of  the  Initial  72  value  item*  polled  in  Round  One, 
there  was  no  clear  conaenaus.  It  waa  decided  to  repeat  these  items 
in  Round  two  to  see  if  a consensus  could  be  attained. 

In  Round  One,  respondents  suggested  three  other,  environmental 
values  as  being  Important.  The  AWR Delphi  project  team  decided  to 
Include  these  items  in  Round  Two,  as  follows: 

• Compatibility  between  ecosystem  and  human  system 
f unc t ions . 

• Regard  for  natural  resources. 

• Regard  for  all  forms  of  life. 

In  accordance  with  Delphi  procedures,  a summary  of  Round  One 
results  was  mailed  to  all  respondents  shortly  before  Round  Two 
was  mailed.  Included  with  each  summary  was  a computer  printout 
showing  the  individual  respondent's  position  on  each  item.  This 
enabled  each  participant  to  compare  his  replies  against  the  medians 
and  interquartile  responses  for  all  participants,  which  were  given 
in  the  Round  One  summary.  (An  Interquartile  range  simply  Bhows 
the  value  below  the  median  that  encompasses  one-quarter  of  all 
replies,  and  the  value  above  the  median  that  encompasses  a second 
one-quarter  of  ail  replies.) 

Thus,  one  portion  of  the  Round  Two  Questionnaire  was  again 
devoted  to  values:  16  values  for  which  consensus  had  not  been 
attained  in  Round  One,  and  three  new  values  proposed  by  Round  One 
respondents . 

The  major  portion  of  the  Round  Two  Questionnaire,  however, 
was  devoted  to  the  seven  water  resources  problems  listed  in  dis- 
cussing the  selection  of  topics  earlier.  For  each  of  the  seven 
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problems,  participants  were  asked  to  give  three  estimates,  as 
follows : 


• Importance  ranklng--Partlclpaats  were  asked  to 
assign  the  numbers  1-7  to  the  problems,  using 
1 for  the  most  important. 


• Timing- -"With  current  trends,  when  will  the 

problem  be  a national  issue:  Now?  In  5\vears? 

In  10  years?  In  20  years?  Later?  Neva 

• Action  tlming--"When  should  action  be  t, 
the  national  level?"  (The  same  timing 
as  above  were  used.) 

Finally,  in  an  open-ended  portion  of  the  Round  Two  Question- 


naire, participants  were  asked  to  suggest  effective  actions  that 
could  be  taken  to  deal  with  the  respective  problems. 


The  Round  Two  Questionnaire  was  mailed  to  the  100  persons  who 
had  returned  Round  One;  74  replies  were  received  by  the  project 
team. 


Analyze  iiound  Two  Returns  and  Prepare  and  Mall  Round  Three- - 
Of  the  16  values  resubmitted  in  Round  Two  because  no  consensus  was 
reached  in  Round  One,  a consensus  was  reached  on  11.  The  remain- 
ing five  were  excluded  from  further  consideration  in  Round  Three. 
The  three  environ., .ental  values  submitted  for  the  first  time  in 
Round  Two  were  all  judged  by  participants  to  be  of  growing  impor- 
tance in  the  future . 

Figure  29  shows  a summary  of  future  estimates  for  each  of  the 
seven  water  resources  problems  posed  in  Round  Two.  As  usual  in 
Delphi  summaries,  median  replies  with  interquartile  ranges  are 
shown. 
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The  open-ended  portion  of  the  Round  Two  Questionnaire  drew 
a wealth  of  responses,  a typical  experience  in  Delphi  polling. 

As  the  AWR  Delphi  final  report  explains: 

More  than  50  suggestions  were  obtained  for  new  prob- 
lems, and  panelists  submitted  more  than  110  new  events, 
of  which  about  40  were  for  the  original  problems,  with 
the  remainder  associated  with  new-problem  submissions. 

More  than  250  new  actions  were  obtained,  with  about 
160  of  these  related  to  the  original  list  of  problems. 

In  some  cases,  problems  offered  by  panelists  seemed  to 
be  more  nearly  events  and  actions  than  problems,  and 
some  reorganization  of  that  material  was  performed  in 
the  preparation  of  Round  Three  forms  for  assessment  by 
the  entire  panel.  ...  The  presentation  of  this  material 
required  lengthy  and  complex  forms. 

This  "lengthy  and  complex"  form  is  just  that--49  oversized 
pages  of  detailed  questions  tasking  respondents  to  make  estimates- 
under  each  of  six  main  headings,  with  further  subdivisions  in 
some  cases: 

• Potential  problems 

• Timing  of  potential  problems 

• Possible  related  events 

• Suggested  actions 

• Timing  of  actions 

• Value  conflicts. 

In  addition  to  this  49-page  questionnaire,  Round  Three  partic- 
ipants were  also  sat  a separate  task  involving  the  analysis  of  the 
problems  presented  in  tentative  sets  on  individual  cards.  This 
separate  second  task  is  of  real  interest,  but  it  created  special 
problems  and  is  not  typical  of  a Delphi  poll  and  so  is  not  dis- 
cussed here. 


A summary  of  Round  Two  results  was  also  prepared  and, 
together  with  Round  Three,  was  mailed  to  the  74  participants  who 
had  returned  Round  Two.  In  due  course,  51  usable  replies  to 
Round  Three  were  returned  to  the  AWR  Delphi  project  team.  To 
recapitulate  participation: 


Round 

Mailed 

Usable  Returns 

1 

124 

100 

2 

100 

74 

3 

74 

51 

Such  a decline  in  participation  as  a Delphi  poll  proceeds  is 
not  unusual,  and  should  be  anticipated  in  planning  such  a project. 
The  extent  and  complexity  of  the  task  is  often  underestimated  at 
the  outset  by  all  parties.  As  the  true  nature  of  the  task  is 
revealed,  many  participants  are  unable  or  unwilling  to  continue. 
The  project  team  might  have  maintained  a higher  level  of  partic- 
ipation by  reducing  the  richness,  but  probably  was  reluctant  to  do 
so  because  of  ltB  original  commitments  to  participants  and  because 
of  the  team's  own  keen  interest  in  the  study  content. 

Analyse  Round  Three  Results  and  Prepare  Finn!  Report- -In  as- 
sessing Round  Three,  the  AWR  Delphi  project  team  concentrated  on 
what  it  labeled  high-response  events  and  high-response  actions  for 
each  of  the  potential  problems.  High-response  was  defined  to  mean 
events  or  actions  for  which  no  more  than  25  percent  of  all  par- 
ticipants assigned  a never  or  a no-answer  estimate. 
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A categorised  tabulation  of  high-response  events  la  given 
below}  ■'  '{s 


Cateaorv  1 

High-Resoonse  Events 

Technological 

15 

(27.7%) 

Soc ioeconomic 

16 

(30.0%) 

Water  depletion  or  scarcity 

8 

(14.8%) 

Growth  and  its  consequences 

4 

(7.4%) 

Government  action 

4 

(7.4%) 

Major  disasters 

3 

(5.5%) 

Miscellaneous 

4 

- (7.4%) 

54 

(100.0%) 

. comparable  tabulation  of  high- 

response 

actions  follows 

Category  High-Response  Actlona 


Government  control 

49 

(34.2%) 

Research  and  development 
Increased  public  education/ 

37 

(25.9%) 

participation 
Planning,  goal  aettirg, 

2 V 

(14.6%) 

formulation 

Actions  by  professional/ 
government  water  resources 

16 

(11.2%) 

personnel 

12 

(8.4%) 

Miscellaneous 

8 

(5.6%) 

143  (100.0%) 


Having  analyzed  Round  Three  results,  the  AWR  Delphi  final 
report  was  prepared  and  distributed  through  the  project  team  to 
all  participating  parties. 
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"Mini-Delphi"  "-Delphi  Simplified  for  Small  Groups 

In  Conference 

Although  the  Delphi  technique  Is  generally  considered  time 
consuming  and  highly  complex,  the  concept  in  modified  form  can  be 
made  relatively  quick  and  simple  for  use  in  a conference  setting. 
The  example  described  below  la  derived  from  CERL  Technical  Report 
D-13,  December  1973,  "Environmental  Impact  Assessment  Study  for 
Army  Military  Programs."  The  example  has  been  rewritten  to  put 
it  in  terms  of  a civil  works  planning  situation. 

The  hypothetical  problem  considered  in  this  example  is  to 
obtain  a consensus  on  the  relative  importance  of  a number  of  en» 
vlronmental  impacts  of  a reservoir  under  study.  The  participants 
could  be  the  study  team,  a cltisen  panel,  an  environmental  group, 
and  so  on.  In  selecting  participants,  it  is  wise  to  follow  some 
general  guidelines  for  establishing  an  effective  panel: 

• Select  members  with  a diversity  of  pertinent 
specialisations . 

• Select  members  of  approximately  equal  status. 

• Avoid  a member  who  is  likely  to  try  to  dominate 
the  panel . 

• Provide  for  rotation  of  the  chairmanship,  if 
appropriate. 

• Provide  for  open  interaction  among  panel  members 
and  between  panel  and  sponsoring  agency. 

In  this  hypothetical  example,  a list  of  eight  possible  im- 
pact areas  are  assumed: 
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• Recreation 

• Noise 

• Construction 

• Asthetlcs 

• Water  quality 

• Controlled  downstream  flow 

• Pool  fluctuation 

• Sedimentation. 

A separate  card  is  prepared  for  each  of  the  above  impact 
subjects.  This  card  includes  a brief  summary  of  the  nature,  ef- 
fect, source,  and  so  on,  of  the  pubject  as  it  relates  to  environ- 
mental impacts  of  the  reservoir  under  s^udy,  The  cards  are  dupli 
cated  to  provide  a deck  of  eight  cards  for  each  participant, 

Each  deck  is  given  a number  and  the  decks  are  handed  out  in  a 
random  order. 

The  participants  are  requested  to  arrange  the  cards  in  their 
decks  and  number  them  in  the  order  in  which  they  perceive  the 
relative  importance  of  the  impact  of  the  reservoir,  on  the  topic 
named,  with  the  most  important  on  top  and  numbered  1. 

Participants  are  then  requested  to  weight  the  impacts  by 
assigning  a percentage  to  each  impact  in  relation  to  the  impact 
on  the  card  above  it.  Thus  the  first  card  would  receive  a weight 
of  100  percent.  The  second  might  be  considered  90  percent  as  im- 
portant as  the  first  and  be  so  marked.  The  third  might  be  con- 
sidered 95  percent  as  Important  as  the  second,  and  so  on. 
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The  decks  are  collected  and  the  information  is  used  to  cal- 
culate the  relative  importance  of  the  impacts.  Before  handing  in 
the  decks,  each  participant  is  asked  to  make  a note  of  the  number 
of  his  deck  so  that  it  can  bo  returned  to  him  for  a second  round, 

Weighting  is  accomplished  as  shown  in  Table  24  for  one  deck. 
Columns  (A)  and  (B)  contain  the  information  obtained  from  the 
deck;  Column  (C)  shows  the  conversion  to  a scale  of  weights. 
Since  the  total  of  (C)  will  be  different  for  each  deck,  the 
weights  are  standardized  by  distributing  1000  points  in  propor- 
tion to  the  numbers  in  Column  (C)  in  the  manner  shown  by  Column 
(D).  Thus,  the  totals  for  each  deck  will  equal  1000. 

Table  24 

VOTES  AND  WEIGHTS  IN  "MINI-DELPHI" 


(A) 

Impacts  in 
Descending 
Order  of 
Importance 

(B) 

Relative 

Percentaaes 

(C) 

Percentage 
of  First 
Impact 

(D) 

1000 
423  “ 
2.36  x 

2.36 

(C) 

1. 

Aesthetics 

100% 

100% 
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2. 

Recreation 

90 

90 

214 

3. 

Sedimentation 

95  (95%  of  90)  86 

203 

4. 

Construction 

65  (65%  of  95)  56 

132 

5. 

Controlled 

downstream  flow 

80 

44 

104 

6. 

Water  quality 

70 

31 

73 

7. 

Pool  fluctua- 

tion 

40 

12 

28 

8. 

Noise 

30 

4 

9 

Totals 

423% 

1000 
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Next,  the  numbers  In  Column  (D)  for  all  cards  are  totaled 
for  each  Impact  and  the  rank  order  of  the  Impacts  is  arranged  In 
descending  order  of  those  totals.  This  order  then  represents  the 
result  of  the  first  round. 

The  results  of  this  first  round  are  presented  to  the  partic- 
ipants And  subjected  to  a period  of  general  discussion.  The 
decks  are  then  returned  to  the  participants  for  a second  round 
in  which  the  participants  may  revise  their  initial  rankings  and 
weightings  to  reflect  new  insights  gained  in  discussing  first- 
round  results. 

Finally,  the  /decks  as  revised  are  again  analysed  as  before 
and  the  result  is  taken  as  the  group  consensus. 

The  procedure  can  also  be  applied  to  a variety  of.  other  prob 
lemB,  such  as  ranking  the  attributes  of  each  plan  in  a 'set  of 
alternative  plans,  as  an  aid  in  ranking  the  alternative  plans, 
or  as  a means  for  capturing,  or  testing  the  commitment  to,  a 


ALTERNATIVE  FUTURES 


General  Description 

Abetraec 

Alternative  futures  methods  of  forecasting  emphasize  what  may 
plausibly  happen  rather  than  what  la  predicted  to  happen,  Study  of 
an  array  of  alternative  futures  is  helpful  in  setting  organizational 
long-term  goals  and  policies,  in  charting  primary  strategies,  and  r 
in  developing  contingency  plans.  It  is  pointed  out  that  a given 
potential  development  may  or  may  not  occur:  if  it  occurs,  It  may 
happen  at  any  of  many  different  times,  and  may  have  any  of  many 
different  potential  Impacts,  Each  unique  combination  of  these  and 
other  variables  constitutes  a different  alternative  future.  Mor- 
phological analysis  and  divergence  mapping  are  discussed  as  ex- 
amples of  alternative  futures  methods.  The  techniques  are  best 
adapted  to  mid-  and  long-term  planning.  A major  problem  is  to 
avoid  confusing  developments  that  are  reasonable  possibilities 
with  those  that  are  expected, 

I 

Definitions 

Techniques  designed  to  develop  alternative  futures  foous  on 
defining  conceivable,  possible,  plausible,  and  probable  futures. 

The  emphasis  is  on  what  societal  features  could  reasonably  coexist 
rather  than  on  how  trends  will  in  fact  develop.  The  approach  is 
designed  to  atretch  the  mind,  surface  hidden  astuniptionu , and  force 
systematic  consideration  of  the  implications  of  all  varieties  of 
futures,  not  just  those  that  seem  to  be  without  surprises. 
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A given  alternative  future  consists  of  any  one  combination 
of  assumptions  about  what  is  conceivable,  possible,  and  probable, 
together  with  assumptions  about  what  will  or  will  not  occur,  when 
the  occurrences  will  be  scheduled,  and  what  the  impact  of  such 
occurrences  will  be.  It  is,  in  brief,  designed  to  portray  a whole, 
organic  society  and  not  just  a part.  Since  each  of  the  dimensions  • 
consists  of  a great  many  possibilities--and  since  any  combination 
can  differ  from  all  others  by  no  more  than  a single  item--the 
number  of  alternative  futures  is  nearly  infinite,  no  matter  how 
narrowly  we  choose  to  define  the  topic  of  conjecture. 

While  every  forecasting  or  conjectural  project  confronts  a 
virtually  infinite  number  of  potential  futures,  only  the  merest 
handful  can  be  examined  in  any  detail.  It  is  essential,  there- 
fore, to  resort  to  some  procedural  framework  that  enables  us  to 
select  for  study  those  few  potential  futures  that,  for  whatever 
reason,  strike  us  as  being  of  greatest  interest  or  value.  One 
such  approach  to  alternative  futures  is  called  morphological 
analyBia. 

Morphological  analvsl a is  at  once  a generic  term  and  the 
name  of  a particular  application  of  the  generic  approach.  In 
modern  times,  the  approach  was  developed  and  advocated  by  Fritz 
Zwicky,  the  late  Swiss/Cal.  Tech,  astronomer,  Zwicky--carefully 
pointing  out  that  the  basic  approach  was  in  use  aB  early  as  the 
1200s--established  the  Society  for  Morphological  Research  in 
Pasadena  in  1951.  A variant  of  morphological  analysis  is  the 
so-called  FAR  (Field  Anomaly  Relaxation)  Method  developed  and 
used  at  the  Stanford  Research  Institute  in  the  late  1980s.  A 
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third  example  of  morphological  analysis  is  the  Divergence  Mapp ing 
method  devised  by  two  authors  (Miller  and  Schwartz)  of  the  present 
Handbook  in  the  early  1970s,  and  now  finding  increasing  use  In 
the  corporate  sector. 

Morphological  analysis  methodology  may  be  characterized  by 
briefly  reviewing  Zvicky's  approach,  which  he  applied  to  technol- 
ogy forecasting.  First,  one  makes  an  exact,  definitive,  and  gen- 
eralized statement  of  the  problem  to  be  solved,  say,  propulsive 
power  plants.  One  then  resolves  the  problems  into  functional 
specifications  that  detail  what  basic  functions  must  be  performed. 
For  instance,  a propulsive  power  plant  must  store  fuel  or  receive 
energy  from  some  source,  must  convert  the  energy  into  suitable 
forms,  distribute  It  somehow  to  points  of  traction  if  it  is  for 
surface  vehicles,  end  so  on. 

For  each  function,  an  exhaustive  list  of  possible  means  of. 
performing  the  function  is  compiled.  These  lists  srs  then  com- 
bined In  a matrix,  with  each  row  representing  a function  and  the 
columns  representing  alternative  means  of  performing  that  function. 
Now,  each  possible  route  through  the  matrix  between  the  first  and 
last  rows  represents  a different  potential  design  for  the  power 
plant. 

The  number  of  different  combinations  is  very  large,  since  a 
change  in  even  one  row  represents  a new  combination.  The  analyst 
then  goes  through  the  matrix,  assigning  efficiency  or  other  pre- 
ferential weights  to  every  option.  Tnese  ratings  Indicate  those 
few  combinations  that  qualify  for  further  study.  If  too  many 
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candidates  remain,  minimum  thresholds  can  be  raised  until  an 
acceptable  number  of  candidate  solutions  remains  for  final  assess- 
ment and  selection. 

Analogous  approaches  are  taken  by  the  FAR  and  Divergence 
Mapping  methods.  FAR  and  Divergence  Mapping,  however,  to  date 
have  been  used  to  select  and  examine  futures  states  of  U.S. 
society,  rather  than  future  technological  devices  or  systems. 

In  Divergence  Mapping,  for  example,  22  different  narrative  "snap- 
shots" of  possible  future  societies  are  devlBed,  based  on  critical 
issues  specified  by  the  user  and  written  in  such  a fashion  that 
no  particular  future  date  is  explicitly  implied.  Users  are  then 
required  to  position  these  snapshots  or  frames  along  a sooner- 
later  line  on  a blank  divergence  map  form.  (This  form  has  22 
slots,  hence  the  need  for  22  frames.  Maps  of  any  size  could  be 
used.)  With  the  frames  in  place,  users  then  trace  alternative 
future  history  tracks  from  the  present  to  the  most  distant  future. 
Finally,  users  examine  the  implications  of  each  future  history  for 
the  critical  issues  they  had  previously  identified. 

Assumptions 

Alternative  futures  methods  are  not  used  unless  the  user 
assumes  there  is  real  vaiuti  in  exploring  what  might  be  in  addi- 
tion to  what  is  predicted  to  be.  More  specifically,  it  is  assumed 
that:  ' 

• A forecast  or  conjecture  topic  can  be  defined  clearly 
enough  to  enable  individuals  to  bring  to  bear  their 
insights  and  experiences  in  inventing  alternative 
futures  for  the  topic. 
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• Systematic  exploration  of  subjective  sketches 
of  the  future  can  make  them  more  quantitative, 
explicit,  and  analytic. 

• Subjective  Judgment  is  a practical,  useful  way 
to  select  a few  potential  futures  for  serious 
study,  out  of  a virtually  infinite  number  of 
possible  futures. 

• For  many  topics  and  purposes,  there  exists  no 
substitute  for  subjective  judgment,  while  for 
many  others  subjective  judgment  is  assumed  to 
be  as  valid  as  objective  judgment. 


History 


As  mentioned  earlier,  the  methodical  use  of  subjective  esti- 
mates to  identify  all  possible  combinations  of  a system  is  of 
ancient  vintage,  extending  back  at  leaBt  as  far  as  the  mystic 
Majorcan  monk,  Ramon  Lull,  in  the  late  1200s,  In  contemporary 

times,  the  development  and  use  of  such  methods  is  one  of  the  main 

!\ 

themes  in  the  rise  of  technology  forecasting  and  societal  fore- 
casting methods.  Loosely  sneaking,  most  methods--objectlve  and 
subjective--now  widely  known*  oh'  in  use  have  their  origins  in  work 
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dating  from  the  late  1950s.'/  j 
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Probably  because  the  earliest  recent  work  emphasized  the 
forecasting  of  physical  technology,  objective  methods  were  devel- 
oped and  used  first.  As  it  became  apparent  that  analyses  even  of 
physical  technology  become  conjecture  at  some  level  of  scope  and 
complexity,  attention  also  turned  to  subjective-  methods . This 
interest  quickened  in  the  mid-to-late  1960b,  as  interest  and  sup- 
port built  for  systematic  conjecture  about  societal  phenomena. 

The  absence  of  strong  theories--or  even  good  models--to  explain 
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societal  change  made  It  mandatory  to  resort  to  subjective  methods 
In  such  cases.  While  it  is  difficult  to  judge,  it  may  be  that 
as  of  the  mid-1970s  there  is  more  interest  in  the  developmd'nt  of 
subjective  methods  than  of  objective  methods. 

?'•  * 1 
1 " 

Main  Uses 

Alternative  futures  methods  find  their  main  applications  in 
two  categories.  In  one  category  are  studies  concerned  with  pros- 
pects for  whole  societies.  Usually,  society  is  taken  to  moan  some 
nation-state  luch  as  the  United  State:  , although  some  studies  deal 
with  global  regions  (e.g.,  the  Third  World)  or  even  with  the  world 
as  a single  whole.  In  a second  category,  alternative  futures 
studies  reflect  the  missions  or  concerns  of  their  sponsors.  Even 
this  second  category  of  study,  however,  more  and  more  often  ac- 
knowledges and  tries  to  deal  with  the  impact  of  the  large  society 
on  particular  interests.  Examples  of  this  second  category  would 
include  the  Educational  Policy  Research  Centers  supported  by  the 
U.S.' Office  '■£  Education,  the  current  worldwide  opinion  poll  of 
corporate  planners  (Project  Forethought),  or  the  use  of  diver- 
gence mapping  as  a strategic  planning  tool  by  several  major  cor- 
porat ions . 

Limits  and  Cautions 

The  principal  limit  and  caution  to  be  observed  in  alternative 
futures  studies  is  easily  stated  but  difficult  to  observe:  such 

forecasts  or  conjectures  are  subjective.  That  is,  they  reflect 
the  never-wholly-exposed  training,  experience,  attJ.  ides,  values, 
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and  motives  of  theit  participants.  The  same  holds  true  in  objec- 
tive approaches,  of  course.  One  might  think  that  the  danger  of 
misunderstanding  would  be  greater  in  a nominally  objective  study, 
tucause  there  are  the  subjective  element  is  denied,  ignored,  or 
understated.  Yet,  in  a peculiarly  elusive  way,  subjective  studies 
are  more  treacherous.  For  example,  the  participants  in  a study 
u*n>»lly  represent  a narrow,  selective,  and  biased  sample  of  a 
population*,  corporate  planners  are  much  more  nearly  like  each 
other  than  they  are  like  other  groups  in  society.  Unconsciously, 
they  accept  many  fundamental  assumptions  peculiar  to  their  sub- 
culture. These  common  but  uncommon  assumptions  may  be  discovered 
in  the  guise  of  a consensus  forecast  about  the  future.  Precisely 
because  the  commonality  of  these  assumptions  had  previously  gone 
unnoticed,  a group  may  accept  its  collective  consensus  as  a 
credible,  valid  forecast  of  the  most  probable  actual  future.  In 
data  processing,  the  term  GIGO  i3  widely  used;  Garbage  In,  Gar- 
bage Out.  In  future  studies,  the  corresponding  term  would  be 
AICO;  Assumptions  In,  Conclusions  Out. 


Other  Techniques 


Techniques  for  future  studies  that  are  moBt  interchangeable 
with  alternative  futures  methods  are  described  in  other  sections 
of  this  Handbook.  They  are  scenarios  and  related  methods  and 
expert-opinion  methods. 
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Product  or  Result 

Like  all  qualitative  methods,  alternative  futures  methods 
run  the  gamut  of  scope,  formal  organ- -«tions,  rigor,  and  product. 

A two-hour  session  using  a blackboard  and  discussion  may  be  use- 
ful but  yield  no  tangible  product.  A Zwicky-type  morphological 
analysis  may  yield  reams  of  computer-generated  matrices  accom- 
panied by  many  pages  of  explanation  and  interpretation.  The 
SRI  FAR  method  yields  extensive  sets  of  clusters,  each  represent- 
ing a compressed  description  of  a potential  future  state  of  some 
major  component  of  society.  Divergence  mapping  yields  22  frames 
(miniscenarios)  positioned  along  a sooner-later  line,  together 
with  a definition  of  the  present,  two  or  more  outlines  of  alterna- 
tive future  histories,  and  a statement  relating  each  future  history 
to  an  organization's  critical  issues. 

Level  of  Detail 

Results  tend  to  be  broad,  holistic,  and  impressionistic 
rather  than  detailed  and  fully  documented. 

Communicability  of  Results 

The  communicability  of  alternative  futures  studies  is  ex- 
tremely variable.  While  everyone  makes  incessant  use  of  subject- 
ive estimates,  few  people  are  acquainted  with  systematic  procedures 
to  make  such  estimates  more  quantitative,  explicit,  and  analytic. 
Furthermore,  the  procedures  themselves  may  often  be  complicated 
and,  to  many  forbidding,  There  is  perhaps  an  unavoidable  trade- 
off between  the  communicability  and  the  credibility  of  results. 


If  simple,  loose  procedures  are  used  the  results  are  apt  to  be 
widely  and  easily  communicable- -but  credibility  will  suffer.  If-- 
as  in  morphological  analysis- -elaborate,  rigorous  procedures  are 
used,  credibility  may  be  improved  (perhaps  too  much  so) --but  many 
people  will  be  unable  or  unwilling  to  take  the  time  and  effort  to 
understand  what  has  been  concluded. 

Credibility  of  Results 

The  purpose  of  developing  alternative  futures  is  lesu  to 
devise  credible  portraits  than  it  is  to  develop  a diverse  array 
of  possibilities.  Hence  credibility  is  less  of  an  issue  in  these 
techniques  than  in  others. 

Span  of  Forecasts 

While  in  principle  any  future  time  span  can  be  used  in  an 
alternative  futures  study,  in  practice  the  time  span  is  determined 
by  two  factors.  First,  there  is  the  estimate  of  the  minimum  in- 
terval of  time  required  for  significant  change  in  the  topic  of 
interest.  For  instance,  one  would  not  in  most  cases  make  an  al- 
ternative futures  study  of  changes  in  societal  trends  during  the 
next  12  months,  because  one  would  assume  that  broad  trends  require 
significantly  longer  than  that  to  undergo  substantial  change.  The 
second  factor  determining  an  alternative  futures  time  span  is  how 
far  into  the  future  participants  feel  qualified  or  inclined  to 
render  subjective  estimates.  Clearly,  this  factor  varies  greatly 
from  one  person,  topic,  or  occasion  to  another.  A safe  generality 
is  that  alternative  futures  are  excellently  adapted  to  looking 
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long  distances  ahead,  work  reasonably  well  for  medium- range  fore- 
casts, and  usually  should  yield  to  other  techniques  for  short- 
range  forecasts. 

Resources  Needed 

Alternative  futures  studies  may  be  conducted  at  Virtually  any 
level  of  effort.  The  resources  required  vary  accordingly.  A two- 
hour  blackboard-discussion  session  requires  little  more  than  a 
trailed  facilitator  and  the  time  of  the  immediate  participants. 

A divergence  mapping  exercise  may  require  a few  person-weeks  of 
effort  extending  over  a period  of  two  or  three  months.  A mor- 
phological analysis  or  a FAR  study  may  require  many  person-months 
or  person-years,  as  well  as  an  extensive  data  base,  experts  in 
many  fields,  and  computer  facilities. 

Procedures 

Planners  will  have  little  trouble  in  performing  the  more 
elementary  forms  of  alternative  futures  studies.  For  more  elab- 
orate forms,  instruction  will  be  needed  in  procedures  and  in 
developing  a strong  data  base, 

Case  Example 

Alternative  Futures  of  Inland  Waterway  Traffic 

In  1972  and  1973,  the  Office  of  Emergency  Preparedness  in 
the  Executive  Office  of  the  President  issued  two  major  reports 
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that  explored  possible  future  energy  options  for  the  nation. 


These  studies  explored  two  major  policy  options: 


• Depression  of  energy  demand  (especially  petroleum) 


• Substitution  of  coal  for  petroleum. 


The  potential  implications  of  these  policies,  if  Implemented, 


are  enormous  throughout  the  economy.  From  the  Corps'  perspective, 
an  especially  crucial  consideration  is  the  impact  on  volume,  ori- 
gins, and  destinations  of  coal  shipped  on  U.S.  inland  waterways. 

At  present,  one  out  of  every  five  tonB  of  coal  mined  in  the  United 
States  travels  on  inland  waterways.  Federal  policy  innovations 
Involving  coal  could  drastically  increase  or  decrease  that  figure. 


The  IWR  elected  to  explore  the  implications  of  the  two  OEP 
studies  with  respect  to  this  single  issue,  OEP's  assumptions  and 
data  were  adopted,  supplemented  by  IWR 'a  other  data  sources, 
knowledge,  and  experience.  (For  example,  IWR  made  some  supple- 
mentary assumptions  about  schedule  slippages  in  construction  of 
nuclear  power  plants.) 


As  a departure  point,  trend  data  on  inland  waterways  coal 
shipments  were  compiled.  It  was  decided  to  project  historic 


trends  into  the  future  on  three  different  bases: 


Executive  Office  of  the  President,  Office  of  Emergency  Prepared- 
ness, The  Potential  for  Energy  Conservation.  October  1972;  and 
Substitution  for  Scarce  Fuels.  January  1973, 


— - in. 


• Alternative  I:  Extrapolate  current  trends 

• Alternative  II:  Apply  energy  conservation  measures 


• Alternative  III:  Apply  fuel  substitution  measures. 

For  many  reasons,  the  potential  percentage  of  all  mined  coal 
shipped  on  inland  waterways  in  the  future  may'vary  significantly 
from  past  trends  in  all  three  of  the  alternatives  chosen  for  ex- 
ploration. Realizing  as  much,  a simple,  standard  range  of  varia- 
tions was  adopted.  This  range  was  projected  for  all  alternatives, 
enabling  direct  comparison  among  the  three  for  edch  of  three  dif- 
ferent assumptions,  The  range  of  variation  adopted,  based  on  cur- 
rent trends,  was  as  follows:  ' 

• Current  percentage  of  coal  shipped  via1 

inland  waterways  207. 

• Current  percentage  halved  107. 

• Current  percentage  increased  by  half  307. 

At  this  point,  a series  of  numerical  assumptions  was  made 
about  future  trends  in  factors  that  would  most  affect  total  coal 
shipments.  These  assumptions  were  carefully  interlinked  in  a cross- 
impact  model,  so  that  analysts  might  vary  one  assumption  and  so 
analyze  its  impact  on  the  others.  The  factors  so  treated  included: 

• Total  coal  production 

• Demand  for  energy 

• Aggregate  price  of  energy 

• Environmental  quality 

• Crude  petroleum  imports 

• Foreign  exchange  debits 

• GNP, 


Summing  up  to  this  point:  OEP  suggested  two  specific  energy 

policy  options,  energy  conservation  and  fuel  substitution.  The 
study  was  designed  to  probe  the  alternative  potential  future  im- 
pacts of  these  pblicy  options  on  shipment  of  coal  by  inland  water- 
ways. Using  the  historic  trend  and  the  fact  that  20  percent  of 
all  mined  coal  currently  is  shipped  on  inland  waterways,  seven 
important  factors  that  would  most  affect  future  total  coal  produc- 
tion were  identified.  Three  basic  alternatives  were  then  pro- 
jected: current  trends,  conservation  measures,  and  substitution 
measures.  For  eaoh  of  these  trends  or  conditions,  IWF  explored 
three  variations  of  percentage  of  coal  shipped  via  inland  water- 
ways: the  current  percentage  (20  percent),  increased  percentage 

(30  percent),  and  a decreased  percentage  (10  percent). 

This  procedure  yielded  nine  projections,  all  within  the 
minimum-maximum  envelope  Indicated  in  Figure  30.  For  a full 
presentation  and  discussion  of  the  nine  alternatives,  the  reader 
1b  referred  to  the  full  report. 

The  reader  should  take  special  care  to  note  that  the  effort 
waB  not  intended  to  be  and  in  fact  was  not  a forecast.  The  study'’ 
point  of  departure  was  an  OEF  staff  study  that  merely  suggested  two 
policy  alternatives  for  discussion  and  deliberation.  The  study 
therefore  was  limited  to  exploring  hypothetical  alternative  futures 
in  which  either  or  both  of  the  policies  were  Implemented.  Such 


Implications  of  OEP  Energy  Conservation  and  Fuel  Substitution 
Measures  on  Inland  Waterway  Traffic.  Institute  for  Water 
Resources,  March  1973,  18  pages. 
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PERCENT  OF  ESTIMATED  CAPACITY  FOP  INLAND 
WATERWAY  COAL  TRANSPORTATION 


FIGURE  30  ALTERNATIVE  INLAND  WATERWAY  COAL  SHIPMENTS 
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studies,  are  useful  not  only  because  they  enable  the  Corps  to  as- 
sess and  respond  to  suggested  policies,  but  also  because  they 
clarify  and  elaborate  on  interdependencies  Involved  In  Corps 
projects^ 
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VALUES  FORECASTING 


General  Description 

Abstract 

Of  all  the  techniques  for  looking  ahead,  values  forecasting 
perhaps  holds  the  greatest  promise  while  to  date  it  has  yielded 
the  fewest  practical  results.  People's  values  (priorities,  opin- 
ions, attitudes,  and  so  on)  are  of  crucial  importance  in  judging 
what  public  actions  and  policies  they  will  support.  Data  on  these 
matters  can  be  collected  through  survey  methods.  Forecasts  of 
changing  values  usually  involve  clustering  values  into  a typology 
and  forecasting  on  the  basis  of  demographic  shifts  or  broad 
societal  scenarios.  Values  forecasting  is  essential  for  the  pur- 
pose of  reflecting  "soft"  human  factors  in  long-term  planning  and 
policy  analysis.  At  the  present  state  of  the  art,  values  studies 
are  extremely  helpful  when  used  in  conjunction  with  other  forecast- 
ing methods  but  are  of  limited  reliability  or  detail  when  used 
alone . 

Definition 

In  discussing  valuation-based  methods  of  futures  forecasting, 
we  arrive  at  what  is  indisputably  at  once  the  most  important,  most 
provocative,  potentially  most  powerful,  most  primitive,  most  recent, 
and  most  controversial  component  of  the  entire  futures  research 
field,  In  the  following  pages  we  have  attempted  to  convey  a sense 
of  what  all  the  excitement  is  about. 
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Why  is  it  chat  individuals- -or  families  or  organizations  or 

•• « 

peoples  or  nations --behave  as  they  do  behave,  rather  than  other- 
wise? At  the  personal  level,  each  of  us  knows  persons  whose  be- 
havior we  characterize  as  "eccentric"--or  "nutty”  if  we  are  in  a 
less  kind  mood.  We  acknowledge  that  such  persons  behava  in  a char- 
acteristic fashion.  But  what  pains  us  is  that  their  behavior  is 
beyond  our  understanding.  We  observe  how  they  behave  without 
understanding  why  they  "act  like  that."  In  the  absence  of  any 
insights  into  the  whys  of  their  behavior,  we  are  unable  to  pre- 
dict what  they  may  do  in  any  given  situation,  and  so  are  con- 
stantly--sometimes  p,ninfully--surprised  by  what  they  do, 

Buried  inside  this  frustrating  failure  to  understand  each 
other  is  a subcultural  dilemma,  Which  persons,  groups,  or  orga- 
nizations in  a society  are  Judged  to  be  odd  or  deviant  is  more  than 
anything  else  determined  by  who  makes  the  Judgment  and  who  has  the 
power  to  enforce  such  Judgments.  One  shorthand  way  to  refer  to 
this  puzzle--without  beginning  to  explain  it--is  to  refer  to! value 
differences  between  or  among  individuals,  groups,  organizations, 
peoples,  and  nations..  From  this  perspective,  everybody  behaves 
rationally  in  accord  with  whatever  s/he/they  believe  to  be  real 
and  with  whatever  s/he /they  believe  to  be  important  in  a given 
case.  Thus  the  primitive  bushman  who  is  afraid  to  have  his  photo- 
graph taken  is  behaving  rationally,  once  we  understand  that  s/he 
sincerely  believes  that  her/his  souL  or  spirit  can  be  physically 
imprisoned  in  her/his  photographic  image. 
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On  the  face  of  it,  all  this  seems  incredibly  distant  from  the 
problems  facing,  say,  the  developer  of  a water  resources  project 
proposal.  And  yet  the  distance  is  more  apparent  than  actual.  Why 
is  it  that  many  proposals  are  opposed  angrily  but  effectively  at 
the  last  moment  by  parties  who  until  that  point  had  evidenced  no 
interest  or  concern?  Surely  the  explanation  must  include  some  con- 
sideration of  differences  in  view  about  what  is  real  and  Important. 
Extreme  behavior  may  he  explained  on  the  basis  that  cherished  values 
have  been--or  are  perceived  to  have  been--attacked  by  others  who 
have  no  awareness  of  or  concern  for  the  importance  of  such  values. 

In  a fundamental  sense,  the  proposal  and  execution  of  projects  in 
the  public  sector  is  inescapably  political.  And  politics,  in  turn, 
is  inherently  a matter  of  mutual  accommodation  of  conflicting  values 
through  bargaining  and  compromise. 

Value  differences,  then- -whatever  values  may  be--are  a crucial 
factor  in  estimating  what  can  and  cannot  be  done,  Political  activ- 
ity--partisan  or  nonpartisan--strives  to  ameliorate  conflicts  that 
can  never  be  resolved.  Politicians  reach  for  the  immediately  ac- 
ceptable answer.  Is  there  some  basis  for  getting  on  with  this 
project  that  all  parties  can  accept,  even  though  no  party  is  fully 
satisfied?  Negotiation,  compromise,  horsa-trading,  bargaining-- 
these  are  the  tools  of  the  practical  applied  values  technologist. 

Values  and  the  valuation  process  are  dif f icult-to-impoBsible 
to  define,  measure,  or  agree  upon  in  making  joint  decisions--that 
is,  decisions  where  more  than  one  party  has  an  Interest  and  some 
power  to  influence  the  decision.  Small  wonder,  then,  that  values 
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analysis  is  so  difficult  and  treacherous.  But  the  difficulties 
only  begin  there.  For  the  fact  is  that  values--whatevbr  they  may 
be-*change , 

Again  at  the  personal  level,  the  same  person  may  change  the 
values  he  defends  from  one  situation  to  another  or  from  one  period 
in  his  life  to  another.  It  is  precisely  because  values  and  value 
priorities  change  that  values  forecasting  methods  are  of  interest. 
In  Bimpler,  more  stable  cultures  than  ours  value  changes  may  be 
scarcely  noticeable.  Even  today  there  are  many  people  who  argue 
that  "what  was  good  enough  for  grandpa  is  good  enough  for  me." 

In  medieval  times,  a person  born  a serf  had  no  aspiration  or  ex- 
pectation of  becoming  lord  of  the  manor.  Industrial  societies 
afford  a drastically  different  view  of  realities  and  priorities. 
Technological  advance,  economic  growth,  improved  access  and  at- 
tainment standards  in  education--these  are  only  a few  of  the  forces 
that  work  for  shifts  in  value  priorities.  Values  forecasting 
acknowledges  the  instability  of  value  preferences  in  modern  times. 
Values  forecasting  aspires  to  forecast  possible  shifts  in  personal 
and  societal  values  over  time.  On  the  basis  of  such  insights-- 
when  they  can  be  achieved--it  is  possible  to  foresee  shifts  in 
| behavior,  or  what  may  happen  in  the  r al  world.  It  is  for  this 

reason  that  values  forecasting  is  important,  and  also  why  it  la 
bo  difficult.  Next  we  consider  briefly  some  approaches  to  values 
I forecasting. 

j Over  the  centuries  many  writers  have  propounded  theories 

[ about  societies--how  they  got  to  be  as  they  are,  how  they  are  at 

| any  given  time,  and  the  conditions  under  which  they  change  to 
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become  something  different.  Often  change  was  imputed  to  changing 
values,  as  in  the  works  of  Spengler,  Gibbon,  Jefferson,  and,  more 
recently,  Toynbee  and  Sorokin. 

In  the  past  30  to  40  years,  and  especially  since  the  rise  of 
psychology  as  a science,  many  outstanding  thinkers  have  concerned 
themselves  with  types  of  people,  developmental  patterns,  and  a 
variety  of  values-based  typologies.  They  were  interested  in  such 
matters  as  a means  of  explaining  why  people  act  as  they  do.  Stu- 
dents of  social  change  have  employed  many  of  the  concepts  developed 
in  psychology  to  explain  why  men  rebel  and  how  societies  grow. 

Values  forecasting  has  been  based  on  a variety  of  approaches. 
Some  significant  work  has  been  based  on  changes  in  a single  cul- 
tural variable,  such  as  McClelland's  work  with  the  (in  /e  for 
achievement.  More  work  has  sought  to  define  people  in  terms  of 
some  limited  set  of  values,  such  as  the  well-known  "study  of 
values"  launched  in  the  1930s  by  Allport  and  Lindzey.  Still 
others  employ  value  typologies.  Maslow's  hierarchy  of  human  needs 
may  be  the  best  known,  but  it  is  by  no  means  the  only  one.  Recent 
work  has  sought  to  characterize  people  in  terms  of  paradigms  and 
ways  of  life.  Life  style  research  and  psychographic  studies  have 
been  developed  chiefly  in  the  marketing  research  field. 

The  central  aspect  of  all  these  studies  is  values  and  their 
associated  attributes.  These  attributes  include  such  "inner" 
characteristics  as  preferences,  desires,  beliefs,  goals,  motives, 
needs,  intentions,  opinions,  attitudes,  and  the  like.  From  the 
pragmatic  standpoint,  all  these  "values"  are  important  because  they 


are  presumed  to  Influence  the  individual's  behavior  and  activities. 
Indeed,  there  are  some  who  think  that  the  driving  force  behind  the 
societal  change  in  the  United  States  has  recently  shifted  from  ad- 
vances in  technology  to  changes  in  values. 

Assumptions 

Values  forecasting  depends  on  a variety  of  assumptions.  First, 
there  is  the  assumption  that  people  know  what  they  value  and  what 
their  values  are  and  will  honestly  report  on  their  feelings  when 
asked  in  suitable  fashion.  It  is  further  assumed  that  people's 
values  shape  their  priorities  and  hence  their  actions.  Conversely, 
the  technique  assumes  that  exterior  conditions  affect  inner  values, 
so  that  adverse  conditions  can  be  expected  to  give  rise  to  values, 
priorities,  and  actiona  aimed  at  remedying  the  adverse  situation. 
Thus,  the  most  basic  tw  .umption  in  values  forecasting  iq  the  se- 
quence linking  (in  either  direction)  what  people  care  about,  what 
they  do,  and  the  kind  of  future  they  create.  To  the  extent,  then, 
that  the  t.iture  is  unaffected  by  the  desires  of  men,  values  fore- 
casting fails  short.  Because  what  we  want  and  what  we  get  are  so 
often  far  removed  from  each  other,  values  forecasting  is  consid- 
ered to  be  more  appropriately  used  as  an  input  to  the  total  fore- 
casting effort  than  as  a technique  to  be  applied  as  the  sole 


source  of  the  forecast. 
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History 

Historically,  a brilliant  example  of  values  forecasting  is 
Aloxis  de  Tocqueville' s Democracy  in  America,  published  in  1835. 

More  recently,  Harvard  psychologist  David  McClelland's  study  of 
The  Achieving  Society  (1967)  is  another  example.  In  marketing, 
perhaps  the  best-known  example  is  the  AIO  (Activities,  Interests, 
and  Opinions)  method  developed  at  the  University  of  Chicago  in 
the  late  1960s  by  William  Wells  and  Douglas  Tigert. 

Extensive  work  in  the  field  is  going  on  at  the  Survey  Research 
Center  at  the  University  of  Michigan,  at  Stanford  Research  Institute, 
and  at  several  corporations  and  universities.  The  field  is  still 
very  much  in  the  formative  stage. 

Main  UseB 

Values  forecasting  is  in  a state  of  rapid  evolution.  Its 
main  uses  to  date  have  been  in  the  fields  of  voter  and  consumer 
opinions  and  behavior.  More  recently,  a broader,  longer-run  em- 
phasis has  begun  to  emei^a.  For  example,  major  projects  in  the 
states  of  Washington,  Iowa,  and  Massachusetts  have  been  undertaken 
to  determine  citizen  preferences  for  future  growth  and  development 
priorities.  Consumer  groups,  public  interest  advocates,  and  public 
and  private  groups  interested  in  environmental  issues  are  seeking 
to  establish  general  preferences  (as  well  as  their  own  legitimacy) 
in  a variety  of  survey  research  activities.  Values  forecasting  is 
also  finding  a growing  role  in  broad  societal  forecasting,  in  in- 
stitutional long-range  planning,  and  in  much  policy  analysis.  Many 
studies  of  quality  of  life  place  values  at  the  core  of  analyses. 
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Limits  and  Cautions 


Values  forecasting  techniques  are  ambitious  In  their  aspira- 
tions but  woefully  weak  in  demonstrable  validity.  They  are 
uniquely  useful  in  incorporating  the  "soft"  elements  of  a society 
into  a forecasting  project --such  matters  as  motivations,  beliefs, 
and  preferences.  It  is  abundantly  clear  that  projections  that 
ignore  these  issues  are  inadequate  and  deceptive.  It  is  also 
clear  that  our  ability  to  deal  with  such  components  in  examining 
societal  prospects  is  limited. 

There  is  a fundamental  and  unresolved  disagreement  among 
authorities  as  to  how  much  difference  value  priorities  actually 
make  in  the  behavior  of  Individuals  and  subpopulationo.  In  sup- 
porting or  opposing  a flood  ontrol  project,  for  example,  some 
observers  argue  that  values  and  principles  weigh  heavily  in  de- 
termining positions.  Others  contend  that  immediate  self-interest 
(what's  in  it  for  me?)  is  nearly  always  the  major  determining 
factor.  Still  other  experts  would  hold  that  immediate,  incidental 
or  accidental  forces  heavily  determine  the  shape  and  views  of  a 
stakeholder  population. 

In  any  case,  most  expi  rts  agree  that  value  differences  are 
complex  and  subtle,  and  that  changes  in  value  position  occur  so 
obscurely  as  to  be  difficult  to  account  for  or  predict  in  many 
instances.  Most  authorities  would  also  agree  that  values  studies 
insights  are  necessarily  global  in  nature,  and  may  be  difficult 
to  relate  to  detailed,  specific  concerns  or  proposals. 
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Given  both  the  increasing  recognition  of  the  importance  of 
values  forecasting  and  of  its  severe  limits.,  wisdom  and  caution 
in  using  such  methods  and  in  relying  on  their  outcomes  1s  indicated, 
The  soundest  counsel  is  not  especially  helpful:  one  Bhould  always 

try  to  incorporate  such  components  in  a forecasting  effort { yet  one 
should  never  rely  on  such  methods  exclusively. 

Other  Techniques 

The  other  forecasting  techniques  that  are  most  interchange* 
able  with  values  forecasting  methods  are  policy  capture,  scenario 
writing,  alternative  future  techniques,  and  some  of  the  expert- 
opinion  methods,  notably  surveys  of  opinions  and  attitudes. 

Product  or  Result 

The  typical  product  of  a values  forecasting  effort  is  a docu- 
ment in  which  the  values,  priorities,  and  opinion  of  the  popula- 
tion studies  are  defined  and  often  sorted  into  a small  number  of 
subtypes.  Typologies  may  be  based  on  the  life-cycle  (couples  with 
young  children,  retired  couples),  around  life  styles  ("swingers," 
"contented  cows"),  or  some  other  dominant  trait  of  interest  to 
the  study  sponsors.  Forecasts  of  anticipated  shiftB  in  the  "pro- 
file" of  value  clusters  are  often  provided.  The  study  report 
will  also  typically  include  correlation  analysis  among  the  items 
reported  or  observed.  Finally,  an  interpretive  section  will  be 
provided,  attempting  to  make  significant  and  useful  generaliza- 
tions and  predictions  about  the  behavior  (through  time)  of  the 
population  sampled, 
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Level  of  Detail 

Valuea  foreeeat  atudlea  ere  almoet  alweya  more  global  and 
leaa  detailed  than  those  typically  provided  by  other  methoda. 
Even  compared  with  other  qualitative  forecaatlng  methoda,  valuea 
forecasts  tend  to  be  general. 

Level  of  Confidence 

Aa  noted  above  under  "Llmlta  and  Cautions,"  aponaora  of 
valuea  forecaat  projecta  ahould  regard  the  reaulta  with  care. 
Value  atudlea  are  uaeful  for  raiaing  aigniflcant  poaalbllltlea 
that  might  otherwiae  be  miaaed  and  for  enriphing  forecaata  pro- 
duced by  other  meana. 


Communicability  of  Reaulta 

Concepta,  model#,  and  theoriea  about  opinions,  attitudes, 
beliefa,  and  valuea  are  atill  in  the  moat  primitive  atagea  of 
development.  As  a corollary,  theae  topica  at  beat  are  extremely 
difficult  to  diacuaa  or  debate  in  a uaeful  way.  Within  this  frame- 
work, values  forecasting  projecta  do  a groat  deal  to  clarify  and 
convey  agreements  and  diaagreements  about  critical  issuea,  variables, 
and  results. 

Credibility  of  Results 

Values  forecasting  projects  are  easy  and  favorite  targets  of 
their  critica,  who  are  numerous.  In  the  first  place,  many  people 
ideologically  refuse  to  believe  that  any  characteristic  that  cannot 
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be  rigorously  counted  or  measured  can  be  significant,  In  the 
second  place,  the  primitive  state  of  value-change  theory  invites 
mockery  and  ridicule.  Further,  most  people  have  strong  precon- 
ceived notions  on  most  subjects  and  tend  to  insist  on  their  models, 
rather  than  explain  them,  Because  values  forecasts  are  inherently 
vulnerable  to  criticisms  from  any  quarter,  and  are  also  favorite 
targets  of  sarcasm,  they  can  be  useful  in  identifying  critics  and 
understanding  the  nature  of  their  ideological  views. 

Span  of  Forecasts 

The  time  span  of  values  forecasts  is  heavily  determined  by 
the  particular  dimension  of  interest.  In  presidential  opinion 
polls,  the  time  span  is  set  by  the  date  of  the  next  presidential 
election.  Many  consumer  marketing  research  studies  emphasise  the 
next  three  to  twelve  months.  Where  fundamental  values  and  value 
changes  are  the  primary  interest,  time  spans  of  several  years  to 
many  decades  must  be  taken  into  account. 

Resources  Needed 

Values  forecasting  is  an  expensive  and  time-conBuming  busi- 
ness. Even  if  an  existing  values  typology  is  adopted,  considerable 
expense  is  involved  in  developing  and  administering  a Burvey  in- 
strument for  the  particular  subject  under  study.  Processing  and 
analyzing  findings  can  also  be  costly.  Specialists  in  values, 
survey  research,  and  statistics  are  required  for  this  work. 


Value  forecasts  (as  distinct  from  data  collection  and  pattern- 
ing) usually  are  tied  to  forecastable  characteristics  of  the  popu- 
lation under  study  (age,  life  cycle,  occupation,  income)  that  cor- 
relate highly  with  specific  values  and  values  patterns  or  to  broad 
concepts  of  societal  evolution,  The  first  approach  is  straight- 
forward and  easy;  the  secoAd’  requires  much  judgment.  In  most  cases, 
both  should  be  carried  out  and  cross-chec.ked--another  reason  why 
valueB  forecasting  is  expensive. 

Procedures 

The  business  of  forecasting  value  change  is  still  far  more 
of  an  art  than  a science.  The  planner  seeking  the  best  advice 
and  insight  will  ask  aid  of  experts  in  attitudlnal  measurement, 
societal  change,  personality  development,  history,  religion,  and 
perhaps  others.  Such  consultants  can  provide  frameworks  and  re- 
sults of  past  values  studies,  but  none  of  them  can  claim  to  offer 
a forecasting  method  of  high  objective  reliability.  Given  this 
state  of  affairs,  the  planner  perhaps  should  start  with  her/his 
own  set  of  intuitive  values  forecasts.  These  plausible  alterna- 
tives can  then  be  refined  and  perhaps  changed  in  number  in  the 
light  of  systematic  critiques  by  the  publics  involved  in  the  deci- 
sion at  hand  and  by  the  kinds  of  experts  mentioned  above. 

Two  illustrations  of  values  research  are  given  below.  The 
first  is  a purely  hypothetical  example  describing  a method  of 
forecasting  changes  in  values;  the  second  deals  with  an  actual 
project  the  aim  of  which  was  to  assess  value  priorities. 
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Case  Example 


A Hypothetical  Susquehanna  Life-Wave  Study 

For  many  decades  It  was  sufficient  to  assess  water  resource 
project  proposals  in  terms  of  a few  conventional,  relatively  clear- 
cut  goals,  such  as  flood  control,  adequate  water  supplies,  and 
satisfactory  inland  waterways. 

In  recent  years,  however,  other,  lesB  clear-cut  requirements 
have  demanded  attention  and  consideration.  Among  these,  one  of 
the  most  troublesome  for  planners  has  been  future  demand  for  recrea- 
tion use  of  water  resource  lands  and  facilities.  Rising  affluence, 
increasing  leisure  time,  greater  mobility,  loss  of  much  open  space 
to  housing  and  industrial  development,  demographic  changes--these 
are  a few  among  many  trends  that  have  made  recreational  land-use 
problems  at  once  much  more  Important  and  much  more  complex  than 
in  former  years. 

Acknowledging  this  challenge,  the  IWR  (hypothetically!  deter- 
mined to  engage  in  basic,  exploratory  research  in  the  field.  IWR 
became  convinced  that  mere  projections  of  past  trends  in  a region-- 
or  even  use  of  a model  formula  in  one  area  that  had  been  used  with 
success  in  others--was  an  inadequate  approach  to  the  recreation 
challenge.  IWR  suspected  that  more  fundamental  changes--changes 
in  people's  life  styles--had  become  and  in  future  would  be  ever 
more  Important  determinants  of  recreational  behavior.  Accordingly, 
IWR  sought  to  discover  and  to  make  an  exploratory  research  applica- 
tion of  some  social-behavioral  model  that  sought  to  address  such 
factors . 
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Having  reviewed  the  field,  IWR  selected  the  "life-ways"  model 
as  a suitable  vehicle  for  exploratory  research  in  the  field.  In 
due  course,  a work  plan  was  developed  and  a study  contract  nego- 
tiated with  a qualified  contract  research  organization.  IWR  quickly 
discovered  that  such  basic  research  is  not  simple  or  Inexpensive. 

The  (hypothetical)  contract  entailed  many  man-years  of  effort  over 
a period  of  30  months.  While  a project  of  this  scope  cannot  be 
discussed  in  detail  here,  the  main  features  of  the  study  are 
briefly  outlined  in  the  following  paragraphs. 

The  life-ways  approach  argues  that  by  combining  several  ob- 
servable and  evaluable  characteristics,  individuals  in  an  adult 
population  can  be  assigned  to  one  among  a half-dozen  basic  life- 
ways  types.  (The  model  acknowledges  that  such  a typology  is 
grossly  oversimplified,  and  that  even  60  life-wayB  typeB  could 
not  exhaust  the  varieties  of  human  behavior  observable  in  any 
community.  Nonetheless,  the  model  argues,  it  is  useful  to  begin 
with  a very  few  basic  types,  then  extend  the  typology,  as  experi- 
ence and  the  requirements  of  particular  studies  dictate.)  The 
six  basic  life  ways  called  out  in  the  model  are! 

• Makers- -These  are  the  men  and  women  who,  working 
effectively  within  the  system,  make  it  go, 

• Preservers --Persons  with  this  life  way,  at  ease 
chiefly  with  the  familiar  and  proud  of  tradition, 
act  as  a sea  anchor  on  change. 

• Takgxs- -Takers  coast,  Making  as  few  waves  as  pos- 
sible, they  take  what  they  can  from  the  system,  feel- 
ing little  obligation  to  the  hand  that  feeds  them. 
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• Changers--Thev  tend  to  be  answer-havers;  they  com- 
monly wish  to  change  things  to  conform  with  their 
views, 

• Seekers»-These  are  the  people  who  search,  often 
gropingly,  for  a better  grasp,  a deeper  under- 
standing, a richer  experience,  a universal  view. 

• Escape rs - -The v are  the  lotus  eaters.  Their 
chief  life  drive  is  to  escape,  to  get  away  from 

it  all,  to  shun  the  pressures  and  demands  of  every- 
day life. 

Without  going  into  details,  the  life-ways  model  argues  that 
most  contemporary  Americans  fall  into  the  Maker  and  Preserver  cate- 
gories, However,  the  model  holds,  difficult  and  rapidly  changing 
times  such  as  our  own  induce  small  but  significant  shifts  into 
the  other  life-ways  categories.  If  we  can  discover  (crudely 
estimate)  how  many  people  in  a population  fall  into  each  category, 
and  if  we  can  determine  which  categories  are  growing  in  a popula- 
tion, then  we  can  anticipate  value  shifts.  The  model  also  em- 
phasizes that  life  wavs  arc  not  to  be  confused  with  life  style s. 

A life  way  represents  a cluster  of  inner  motivating  values,  while 

< 

a life  style  represents  any  among  many,  many  different  behavior 
patterns  through  which  the  driving  value  cluster  can  be  expressed. 
Thus,  there  are  many  potential  life  styles  for  each  and  every  life 
way. 

In  the  IWR  exploratory  research  project,  the  object  was  to 
determine  if  the  life-ways  model  could  be  intelligibly  applied  to 
an  actual  population.  The  region  selected  was  the  Susquehanna 
River  Basin,  comprised  of  specified  counties  in  New  York,  Pennsyl- 
vania, and  Maryland.  It  was  hoped  that  survey  research  methods 
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might  make  it  feasible  to  estimate  crudely  what  fraction  of  the 
adult  population  in  the  study  region  fell  into  each  of  the  life- 
ways  categories.  It  was  also  hoped  thAt  emergent  trends  in  chang- 
ing life  ways  might  be  identified.  If  this  could  be  done,  1WR 
felt,  useful  new  insights  valuable  for  recreational  and  many  other 
water  resources  planning  purposes  might  be  obtained.  However,  the 
frankly  exploratory  nature  of  the  work  was  emphasized,  so  that 
advance  guarantees  of  immediately  and  directly  usable  results  could 
not  be  given. 

But  how  was  the  actual  sorting  of  people  into  life-ways  cate- 
gories to  be  accomplished?  The  life-ways  model  itself  offers  a 
key  to  the  allocation  task.  The  model  argues  that  each  life  way 
is  associated  with  distinctive  patterns  under  each  of  the  follow- 
ing main  headings: 

• Life  goals 

• Sources  of  meaning 

• Sources  of  truth 

• Psychological  needs 

• Belief  systems 

• Morality  patterns 

• Time  orientation. 

Under  each  of  these  main  headings,  a standard  inventory  of 
items  has  been  devised,  representing  the  range  of  preferences 
associated  with  the  various  life  ways.  The  number  of  items  under 
each  main  heading  varies  from  as  few  as  three  under  time  orienta- 
tion (past,  present,  future)  to  as  many  as  20  under  life  goals. 
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By  asking  individuals  to  select  preferences  under  each  of  these 
main  headings,  it  was  hoped  that  individuals  could  be  readily 
assigned  to  one  of  the  six  life-ways  categories. 

As  already  mentioned,  the  survey  research  approach  was  selected 
as  the  obvious  one  for  the  study,  Survey  research  methodology  has 
been  well  developed  for  marketing  research  and  is  used  throughout 
the  behavioral  and  social  sciences  as  well.  Accordingly,  a strat- 
ified random  Bample  of  1500  adult  residents  in  the  region  was 
selected,  forming  a representative  cross  section  of  the  popula- 
tion. Experienced  field  interviewers  were  recruited  and  trained 
for  the  survey.  A structured,  face-to-face  in-depth  interview 
instrument  was  developed,  consisting  of  more  than  200  items  re- 
quiring an  average  of  three  hours  to  complete. 

Many  of  the  items  on  the  interview  form  dealt  directly  with 
the  traits  associated  with  life  ways,  as  discussed  above.  Other 
items  covered  included: 

• Standard  demographic  information  (age,  sex,  years 
of  residence  in  the  region,  income  level,  educa- 
tion level,  and  so  on). 

• Items  used  in  earlier  values  surveys  elsewhere,  so 
that  results  obtained  in  the  Susquehanna  Basin  could 
be  assessed  against  other  results. 

• An  inventory  of  individual  pursuits,  including 
associated  activities  and  plans  and  expectations 
for  the  future  related  to  these  pursuits. 

In  barest  outline,  such  was  the  study  design  adopted  for  the 
hypothetical  life-ways  forecast  study  in  the  Susquehanna  River 
Basin,  The  project  is  costly,  ambitious,  and  experimental.  Yet 
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the  cost  and  risk  are  judged  by  IWR  to  be  coimiensurate  with  the 

growing  importance  of  personal  and  social  values  and  value  changes  j 

in  every  public-sector  project.  f 

Again,  the  reader  la  reminded  that  the  project  outlined  above  ] 

is  a hypothetical  one,  one  that  IWR  has  ne i the r scheduled  nor  con-  j 

temp la ted.  The  scenario  is  offered  here  as  indicative  of  the  form,  i 

dimension,  and  potential  utility  of  values  forecasting  projects.  j 

It  is  expected  that  such  studies  will  become  increasingly  common  | 

in  the  years  just  ahead,  in  both  the  public  and  private  sectors 

of  society.  ! 

Actual  Values  Study  in  the  Susquehanna  River  Basin  j 


The  Susquehanna  River  Basin  was  named  as  the  site  of  the 
hypothetical  life-ways  forecasting  study  only  because  of  an  ex- 
ample of  an  actual,  values-related  study  project  there  is  available 
to  cite  as  a second,  actual  example  of  values  analysis, 

In  the  actual  example,  the  object  was  to  discern  how  various 
interested  parties  in  the  Basin  perceived  water  resource  problem 
priorities.  Although  not  specifically  a forecasting  study,  it  was 
designed  to  guide  the  Corps'  future  actions.  It  will  be  noted 
that  the  study  partakes  both  of  survey  techniques  and  policy 
capture  but  is  unique  in  that  it  specifically  contrasted  the  values 
of  the  research  group  (the  Coordinating  Committee)  with  that  of  the 
affected  public. 
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The  Susquehanna  River  Basin  Coordinating  Committee  was  or- 
ganised in  1963.  Ita  mission  is  to  ensure  that  the  three  states 
(New  York,  Pennsylvania,  Maryland)  and  seven  federal  agencies 
(the  Corps,  Agriculture,  Commerce,  FPC,  HEW,  HUD,  Interior)  have 
their  views  adequately  represented  in  the  overall  planning  effort. 

In  pursuit  of  its  mission,  the  Committee  retained  a research 
team  from  the  University  of  Michigan.  The  team  was  asked  to  study 
means  of  improving  communications  among  the  several  stakeholders 
represented  on  the  Committee,  and  between  them  and  the  residents 
of  the  Basin. 

The  particular  study  cited  below  was  limited  to  four  counties 
in  southern  New  York  State  (Chemung,  Steuben,  Tioga,  Broome),  and 
one  county  (Tioga)  in  north-central  Pennsylvania.  In  form,  the 
study  consisted  of  a series  of  face-to-face  interviews,  plus  ques- 
tionnaires to  be  completed  and  returned  after  the  interviews.  Per- 
sons interviewed  were  government,  civic,  and  community  leaders  who 
either  were  interested  in  water  resource  development  or  were  in  any 
case  in  a position  to  influence  such  development  in  the  Basin.  In 
all,  189  persons  were  interviewed,  of  whom  155  completed  and  re- 
turned post- Interview  questionnaires. 

Several  issues  were  addressed  in  the  study,  of  which  only 
one  is  discussed  here.  A list  of  water  resources  problems  was 
presented  to  the  luterviewees,  and  they  were  asked,  How  would 
you  rank  in  importance  each  of  thise  current  water  resource  prob- 
lems? 


Included  among  the  problems  listed  were: 

• Flood  control 

• Preservation  of  environmental  quality 

• Recreation 

• Water  pollution 

• Water  supply 

• Low-flow  augmentation. 

Table  25  indicates  which  four  problems  were  ranked  of  great- 
est importance --in  which  order — by  interviewees  in  each  of  the 
counties  surveyed.  ,t 

Separately,  Committee  members  and  staff  were  also  asked  to 
rank-order  the  problems.  Actually,  they  were  requested  to  rank- 
order  the  list  in  each  of  two  ways: 

• According  to  their  own  personal  estimates. 

• According  to  the  rank-ordering  they  expected 
interviewees  in  the  counties  surveyed  would 
assign. 

Table  26  tabulates  the  results  of  the  Committee-staff  exercise. 
Also  shown  for  comparison  are  the  actual  rank-orderings  assigned 
by  interviewees  in  two  of  the  counties  surveyed. 

If  for  the  moment  we  assume  that  rank-ordering  of  problems 
reflects  in  part  a rank-ordering  of  values  held,  it  is  clear  that 
there  were  significant  value  differences  between  the  Committee 
and  its  staff  on  the  one  hand  and  residents  of  the  region  on  the 
other.  It  is  bIbo  clear  that--until  the  Burvey  was  made--these 
value  differences  were  unsuspected  by  the  Committee  and  its  staff. 


Table  26 


DIFFERENCES  IN  PERCEPTIONS  OF  PRIORITY 
WATER  PROBLEM  CATEGORIES 


Sources  and 
Basis  of 
Rankings 

Coordinating 
committee  (own 
evaluation) 

Coordinating 
committee  (what 
local  people 
would  think) 

Local  residents 
of  Broome  and 
Tioga  Counties 


First 

Priority 


Flood  control 


Water  supply 


Pollution 


Second 

Priority 


Water  supply 


Flood  control 


Recreation 


Third 

Priority 


Pollut ion 


Pollution 


Water  supply 


Exactly  which  values  are  involved,  and  why  and  how  greatly  they 
differ,  and  what  they  import  for  project  planning--all  these  press* 
ing  issues  would  require  further  research  for  resolution.  None- 
theless, as  this  actual  example  demonstrates,  value  differences 
are  important  in  planning  for  the  future,  and  they  can  be  uncovered 
by  intelligent  use  of  straightforward  methods. 
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Appendix  A 


FORECASTING  TECHNIQUES  EXAMINED 

Fart  I*.  Initial  List  of  150  Forecasting  Approaches 

1*  Forecasting  via  Surveys 

Delphi 

Panels 

Public  opinion  polls 

Surveys  of  activities,  events,  units,  etc. 
Surveys  of  intentions 
Surveys  of  attitudes  and  priorities 
Surveys  of  hopes  and  fears 

2*  Barometric  or  Indicator  Forecasting 

Economic  indicators 
Social  indicators 
Precursor  events 
Diffusion  indices 
Amplitude-adjusted  indices 
Analysis  of  critical  factors 
Signals  of  change 
Technological  audits 
interpretation  of  behavior(s) 

Analysis  of  limits  and  barriers 
Prediction  of  changeover  points 

3.  Forecasting  via  Trends 

Trend  extrapolation 
Exponential  trends 
Nonexponential  trends 
Exponential  smoothing 
Time-series  data 
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3. 


(Continued) 


Trends  with  a limit 
Nonlinear  trends 
Regression  analysis 
Least  squares  method 

Curve  fitting  with  judgmental  modification 

Lagged  variables 

Dummy  variables 

Statistical  probabilities 

Probabilistic  forecasting 

Intuitive  extrapolation 

Bayesian  models 

propagation  of  variance 

Link-relative  prediction 

Substitution  forecasting 

Pearl  formula 

Gomperz  law 

Envelope  curves 

Learning  curves 

Correlation  analysis 

Correlation  coefficients 

Autocorrelation 

Cycle  analysis 

Moving  averages 

Box -Jenkins 

X.-U 


Growth  curve  models 
Structural  models 
Readiness  models 
Rigid  (computer)  models 
Macroeconomic  models 
Microeconomic  models 
Statistical  models 
Diffusion  models 
Gaming 

Gaming  theory 
Chains  of  industries 
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4.  Forecasting,  via  Models  and  Simulations  (Continued) 


Input-output  analysis 
Contextual  mapping 
Cross-impact  analysis 
Operations  research 
Linear  programming 
Dynamic  programming 
Mission  networks 
Systems  analysis 
Functional  analysis 
Integrated  information  systems 
Logical-analytic  frameworks 
Adaptive  search 
Work  flows 

Parametric  sensitivity 
Marginal  » 

Risk  assessi 
Cost-benefit  * lysis 
Feedback  techniques 
Sensitivity  analysis 
Utility  profiles 
Monte  Carlo 
PERT /time 
PERT/cos t 

Critical  path  method 
Line-of-bo lance 
Milestone  system 
Gantt  bar  charts 
KSIM 

Return  on  investment 

Return  on  assets 

Return  on  equity 

Attribute  listing 

Technological  progress  functions 

Technological  mapping 

Perspective  trees 

Normex  forecasting 

SRI  Gulf  energy  model 

Fuzzy  algorithms 

Oil  price  simulation  model 
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4.  Forecasting  via  Models  and  Simulation  (Continued) 


J 


Policy  capture 
Signed  digraphs 

5.  Normative  Forecasting 

Vertical  relevance  trees 

Horizontal  relevance  trees 

Vertical  decision  matrices 

Horizontal  decision  matrices 

Decision  theory 

Morphological  modeling 

Field  anomaly  relaxation  method 

Divergence  mapping 

Qualitative  scenarios 

Quantitative  scenarios 

Surprise-free  projections 

Canonical  trend  variation 

Study  of  alternative  futures 

Subjective  estimates  of  probabilities 

Estimates  of  preferences 

Social  trend  analysis 

Estimates  of  needs  and  priorities 

Technological  assessments 

Policy  forecasting 

Value  analysis 

Life  styles 

Life  ways 

Policy  issue  knowledge 
Introspective  forecasting 
Activities,  Interests,  opinions  (AIO) 
PBychographics 
Crosa-cultural  comparisons 


Forecasting  via  Analogy  and  Creativity  Techniques 


Historical  analogy 
Growth  analogies 
Bionics 

Personal  analogy 


•’"»»  a-sMME.’nniin  i m ■w»iwnai([smiww»<l“* 


6.  Forecasting  via  Analogy  and  Creativity  Techniques 

( Continued) 

Direct  analogy 
Symbolic  analogy 
Fantasy  analogy 
Hypothetical  situations 
Brainstorming 
"Buzz"  groups 
"Genius"  forecasting 
Prescience,  clairvoyance 
Operational  creativity 
Analogy  with  case  examples 
Utopias  and  dystopias 
Science  fiction 
Synectics 

Study  of  unanticipated  events 
Macrohistorlcal  cycles 
Thinking  in  parallel  planes 
Thinking  with  specified  concepts 
Thinking  with  basic  elements 
Thinking  with  outline  strategies 
Thinking  with  diverse  viewpoints 

Part  II:  The  73  Methods  Briefly  Described 

1.  Cost-benefit  analysis 

2.  Statistical  models  (Bayesian) 

3.  Marginal  analysis 

4.  KSIM 

5.  Mission  flow  diagrams 

6.  Parameter  analysis 

7.  Cross-impact  analysis 

8.  Input-output  analysis 

9.  World  oil  price  simulation 

10.  Breakthroughs 

11.  Precursor  events 

12.  Econometric  forecasting 

13.  Dynamic  models 

14.  Structural  models 
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15.  Decision  analysis 

16.  Morphological  modeling 

17.  Decision  matrices 

18.  Relevance  trees 

19.  Theoretical  limits  and  barriers 

20.  Analysis  of  industrial  behavior 

21.  Technological  audit 

22.  Social  trend  analysis 

23.  Scenario  writing 

24.  Canonical  trend  variation 

25.  Surprise-free  projections 

26.  Social  indicators 

27.  Leading  Indicators  (economic) 

28.  Change  signals  monitoring 

29.  Critical  factors  analysis 

30.  Estimates  of  preferences 

31.  Subjective  estimates  of  probability 

32.  Prediction  of  changeover  points 

33.  Amplitude -ad jus  ted  index 

34.  Diffusion  index 

35.  Authority  or  "genius"  forecasting 

36.  Surveys  of  Intentions  or  attitudes 

37.  Surveys  of  activities  or  units 

38.  Panels 

39.  Delphi 

40.  Psychographics  or  life  style 

41.  Activities,  interests,  opinions 

42.  Life  ways 

43.  Historical  analogy 

44.  Alternative  futures  (FAR) 

45.  Divergence  mapping 

46.  Introspective  forecasting 

47.  Utopias /dystopias 

48.  Modes  and  mechanisms  of  change 

49.  Study  of  forceB  of  change 

50.  Macrohistorical  cycle 

51.  Cross-cultural  comparisons 

52.  Synectics 

53.  Brainstorming 

54.  Bionics 

55.  Science  fiction  as  forecasts 


Exponential  smoothing 
Simple  regression 
Moving  averages 
Multiple  regression 
Envelope  curves 
Growth  curves 
Link-relative  prediction 
Box-Jenkins 
Cycle  analysis 
Systems  analysis 
Risk  analysis  simulation 
Contextual  mapping 
SRI  Gulf  energy  models 
Games 

Policy  capture 
Probabilistic  forecasting 
Norttex  forecasting 
Substitution  forecasting 


Part  III s The  31  Methods  Described  in  Detail 


Trend  extrapolation 

Social  trend  analysis 

Precursor  events 

Modes  and  mechanisms  of  change 

Box-Jenkins 

Probabilistic  forecasting 
Subjective  estimates  of  probability 
Environmental  systems  analysis 
Dynamic  models 
Cross-impact  analysis 
KSIM 

Input-output  analysis 
Decision  analysis 
Relevanc  treeB 
Normex  forecasting 
Policy  capture 
Games 

Contextual  mapping 
Risk  analysis 
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Mission  flow  diagrams 
Scenarios  and  related  methods 
Surprise-free  projections 
Morphological  analysis 
Alternative  futures 
Divergence  mapping 
Authority  forecasting 
Surveys  of  attitudes 
Panels 
Delphi 
Life  ways 
Synectics 


Part  IV;  The  12  Methods  Selected  for  tl 

1.  Trend  extrapolation 

2.  Pattern  identification 

3.  Probabilistic  forecasting 

4.  Dynamic  models 

5.  Cross-impact  analysis 

6.  KSIM 

7.  Input-output  analysis 

8.  Policy  capture 

9.  Scenarios  and  related  methods 

10,  Expert-opinion  methods 

11,  Alternative  futures 

12,  Values  forecasting 
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Appendix  B 


GLOSSARY  OF  TERMS 


Algorithm!  Any  system  of  counting  or  computing. 

Alternative  Futures;  Combinations  of  assumptions  about  what 
may  occur,  what  will  occur,  and  what  the  impact  of  such 
occurrences  will  be.  Designed  to  portray  whole  organic 
societies. 

Analysis!  Separating  the  whole  into  its  parts  to  discover  their 
natures,  functions,  and  relationships. 

Analytical  Reasoning!  Drawing  conclusions  by  means  of  analysis. 

Attitude!  Disposition,  opinion,  or  emotion. 

Attitudlnal  Survey!  An  opinion  poll  to  obtain  data  on  the  atti- 
tudes of  a population. 

Authority  Forecasting!  Pronouncements  concerning  the  future 
made  by  a recognized  expert  or  authority. 

Autocorrelation:  The  degree  of  correspondence  or  agreement  among 

values  of  the  same  variable  at  different  time  periods. 

Autoregressive!  A model  used  in  the  Box-Jenkins  method  in  which 
the  variables  are  the  lagged  variables  of  the  initial  vari- 
able. 

Base-Line  Forecast!  The  starting,  usually  simplistically  derived 
forecast  that  is  refined  by  more  sophisticated  methods, 

Box-Jenkins i ; pattern  recognition  forecasting  technique  used 
where  there  is  no  readily  apparent  pattern  to  a series  of 
data. 
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Brainstorming:  The  unrestrained  offering  of  ideas  or  possible 

alternatives  in  an  attempt  to  reach  some  creative  solution. 

Canonical  Variations:  in  forecasting,  the  different  plausible 

directions  in  which  the  present  may  develop. 

Cause-Effect  Reasoning:  Drawing  conclusions  based  on  the  premise 

that  whatever  occurs  is  the  outcome  of  some  preceding  occur- 
rence or  state  of  affairs. 

Change-Over  Point:  The  point  at  which  a step  function  or  phase 

change  occurs,  signifying  a discontinuity, 

Citizen  Participation:  The  inclusion  of  members  of  affected 

populations  in  the  planning  and/or  implementation  of  a 
project. 

Clusters:  Well-defined  groups  whose  members  are  interrelated 

and  have  some  commonality. 

Conceivabilitv:  Within  the  realm  of  imagination. 

Conjecture:  Inference,  theory,  or  prediction  based  on  gueaswork. 

Consequences : Results  of  decisions  or  actions. 

Correlation/Correlation  Coe f f icients : The  degree  of  relative 

correspondence  or  agreement  between  two  events,  sets  of 
data,  or  theories. 

Correlation  Analysis:  Analytical  procedures  to  derive  correlation. 

Credibility;  The  degree  to  which  results  are  accepted  as  indica- 
tive of  reality. 

Cross -Correlation ; The  degree  of  correlation  among  variables; 
more  roughly,  the  impact  of  one  event  upon  another  in  a 
cross-impact  matrix. 


Cross-Impact  Analysis:  A systematic  means  of  studying  interrela- 

tionships among  events  or  developments,  often  in  the  form 
of  a matrix  in  which  paired  elements  are  compared. 

Cycle:  A period  of  time  in  which  a round  of  regularly  recurring 
events  is  completed. 

Cyclic  Curves:  A line  on  a graph  that  curves  in  such  a manner  as 

to  display  a cycle. 

Data : Facts  or  figures,  known  or  assumed. 

Decay  Curves:  A line  on  a graph  that  is  curved  in  such  a way  as 

to  display  decreasing  values. 

Decision  Analysis:  A probabilistic  forecasting  method  that  builds 

a "decision  tree"  as  a logical  approach  to  a complex,  dynamic, 
and  uncertain  situation. 

Decision  Variables:  The  variables  to  be  taken  into  account  in 

building  the  decision  tree. 

Delphi  Polling:  A special  type  of  opinion  polling  technique  in 

which  participants  may  compare  and  revise  estimates  before 
a final  conclusion  is  reached. 

Demographic : Relating  to  population  studies--birch  rates,  age 

spectra,  places  of  residence,  and  so  on. 

Discontinuity:  A sudden  change  in  a trend  that  is  not  explained 

by  historical  data. 

Divergence  Mapping:  A type  of  futures  exercise  in  which  "snapshots" 

of  possible  future  societies  are  fitted  into  a blank  form 
along  a sooner-later  line.  The  map  is  then  used  to  trace 
alternative  future  history  tracks. 

Dynamic  Model:  A formal  model  that  allows  changes  in  the  system 

to  be  derived  as  a function  of  time. 
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DYNAMO:  A computer -language  compiler  designed  for  computer  simu- 

lation of  dynamic  models. 


Envelope  Curves:  Curves  on  a graph  that  form  an  envelope  or  outer 

limits  for  the  phenomena  of  interest. 

Environment : The  conditions,  circumstances,  and  influences  that 

surround  and  affect  an  individual,  group,  place,  or  thing. 

Event  Path:  One  of  a number  of  possible  tracks  along  the  branches 

of  an  event  tree. 


Event  Tree:  An  approach  used  in  risk  analysis  to  estimate  the 

failure  probability  of  various  protective  components. 

Expert/Expertise : Recognized  as  having  much  training  or  knowledge 

in  a particular  field,  and  hence  considered  to  be  expert. 

Explicit  Assumptions:  Those  things  overtly  expressed  that  are 

taken  for  granted. 

Exponential  Curves!  Lines  on  a graph  that  display  the  character 
of  exponential  growth.  Also  called  "J"  curves  in  reference 
to  their  appearance. 

Exponential  Smoothing:  The  procedure  of  fitting  data  of  exponen- 

tial form  to  a smooth  curve. 

Extrapolation:  Extension  of  data  over  time  according  to  specific 

rules. 

FAR:  Field  anomaly  relaxation;  a term  UBed  to  describe  one  kind 

of  morphological  analysis  used  to  devise  scenarios. 

Fault  Tree:  An  approach  used  in  risk  analysis  to  determine  the 

probabilities  and  consequences  of  impacts  resulting  from  a 
fault  in  the  system. 

Feedback:  The  return  of  part  of  the  result  of  an  event  to  affect 

the  event  itself. 
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Feedback  Loop:  A line  in  a dynamic  model  that  traces  the  cause- 

and-effect  relationships  from  a given  variable  back  to  it- 
self. May  be  positive  (additive)  or  negative  (subtractive). 

Field  Anomaly  Relaxation;  See  FAR. 

Forecast,  Forecasting;  Used  in  several  senses:  prediction, 

identification  of  possibilities,  physical  plausibilities, 
desirables;  is  usually  to  be  distinguished  from  a projection. 

Frames:  The  "snapshots"  used  in  divergence  mapping  to  outline  or 

portray  one  possible  future  at  one  point  in  time. 

Frequency  Distribution:  An  arrangement  of  data  that  shows  the 

frequency  of  occurrence  of  the  different  values. 

Future:  The  prospective  or  potential  conditions  of  a specific 

group,  place,  event,  institution,  in  a time  that  is  to  come. 

Futurisms  The  art  and  science  of  studying  the  future. 

Futurist:  One  who  engages  in  studies  of  the  future. 

Goal:  The  object  or  end  that  one  strives  to  attain. 

Growth  Curve:  A line  on  a graph  that  displays  the  manner  in  which 

something  grows. 

Histogram:  A bar  graph  showing  the  frequencies  of  occurrences  of 

a specified  item  within  a specific  range. 

Holistic:  As  a whole;  all  at  once;  including  as  many  aspects  as 

conceivable;  the  totality. 

Impact:  Force  or  effect  of  one  event  on  another. 

Impact  Assessment:  A determination  of  the  nature  and  relative 

importance  of  the  effect  of  one  event  on  another. 
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Implicit  Assumptions;  Those  things,  understood  though  not  overtly 
expressed,  that  are  taken  for  granted. 

Indicator;  An  event  or  situation  that  may  be  taken  to  express, 
or  indicate,  the  presence  of  an  event  or  situation  in  a dif- 
ferent area;  proxy  data. 

Inflection  Point;  The  point  at  which  a curve  changes  its  rate  or 
direction  of  change. 

i 

Input -Output  Analysis;  A descriptive  model  of  the  economy  in 
which  1-0  tables  are  used  to  trace,  predict,  or  evaluate 
the  effect  of  changes  in  the  system. 

Input-Output  Tables;  These  tables  show  the  physical  relationships 
(such  as  value,  flow)  among  goods  and  services  in  an  indus- 
try, region,  or  some  other  entity  at  a specified  point  in 
time. 


Intentions  Survey;  Surveys  of  the  intentions  of  people  regarding 
some  future  act  they  might  take. 

Interactive  Computer  Models;  Models  that  are  designed  so  that 
the  user  may  alter  Interacting  variables  in  the  program  and 
have  the  computer  simulate  the  model's  behavior  under  new 
conditions. 

Interquartile  Range;  The  value  below  the  median  that  encompasses 
one-quarter  of  the  data  and  the  value  above  the  median  that 
encompasses  a second  one-quarter  of  the  data. 

Intervening  Variable;  The  link  between  two  events;  the  interven- 
ing variables  of  most  Interest  in  forecasting  work  are  causal 
variables  and  correlating  variables  and  (what  are  often  mis- 
taken for  these)  coincidental  variables. 

Intuitive  Reasoning;  Drawing  conclusions  based  on  intuition. 

Inventory  Theory;  A framework  of  concepts  and  procedures  by  which 
probabilistic  estimates  of  given  needs  and  times  can  be  made. 
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KS IM:  A cross-impact  simulation  technique  that  uses  both  quanti- 

tative and  qualitative  data  in  a computer  program  that  cal- 
culates and  displays  changes  in  variables  over  time.  KSIM 
stands  for  Kane  SIMulation,  after  Julius  Kane,  Inventor  of 
the  method. 

Lagging  Indicator;  An  event  or  situation  that  may  be  taken  to 
express,  or  indicate,  the  earlier  occurrence  of  an  event  or 
situation  in  a different  area;  opposite  of  a leading  indi- 
cator, 

Leading  Indicator;  An  event  or  situation  that  may  be  taken  to 
express,  or  indicate,  the  probable  later  occurrence  of  an 
event  or  situation  in  a different  area;  opposite  of  lagging 
indicator. 

Life  Style:  The  manner  in  which  an  individual  outwardly  expresses 

his/her  existence;  distinguished  from  life  way  in  being  more 
superficial,  changeable,  and  exterior. 

Life  Way;  A basic  personality  type  characterised  by  clusters  of 
motivating  values;  to  be  distinguished  from  life  style  (which 
see) . 

Linear  Curve;  A line  on  a graph  displaying  the  results  of  an  equa . 
tion  whose  variables  are  in  the  first  power  only  (l.e.,  non- 
exponential). ’ . 

'! 

Long-Range:  Far  off,  distant,  not  Immediate;  in 'forecasting,  usu- 

ally refers  to  five  years  or  more  into  the  future. 

Markov  Process:  A probabilistic  forecasting  method  from  which  is 

estimated  the  probability  that  a process  will  be  in  a given 
state  in  an  event  chain. 

Mean:  Arithmetic  average;  found  by  dividing  the  sum  of  two  or 

move  quantities  by  the  number  of  those  quantities. 

Mechanism  of  Change:  .The  means  or  instrument  by  which  a change 
is  brought  about. 
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Methodology:  A system,  or  orderly  arrangement,  of  methods. 

Model:  A representation  or  simulation  of  a system  or  process 

showing  interacting  elements. 

Modes  of  Change:  How  or  why  a change  occurs, 

Monte  Carlo  Simulation:  A process  analogous  to  roulette  in  which 

combinations  are  thrown  out  at  random.  Estimations  of  prob- 
abilities are  made  from  records  of  these  combinations  and 
used  for  forecasting. 

Morphological  Analysis:  The  process  of  resolving  a basic  problem 

area  into  its  basic  elements,  then  combining  and  recombining 
these  elements  into  new  arrangements  for  further  study.  See 
also  divergence  mapping  and  FAR, 

Morphology:  The  scientific  study  of  form  and  structure. 

Moving  Averago;  A model  used  in  the  Box-JenkinB  method  that  sub- 
tracts previous  values  of  the  error  from  the  residual.  It 
is  also  a means  of  smoothing  data  in  making  trend  extrapola- 
tions. 

Multiple  Regression  Analysis:  The  numeric  procedure  of  calculat- 

ing the  coefficients  among  more  than  two  series  of  variables. 

Non-Markov  Process:  A probabilistic  forecasting  method  in  which 

is  estimated  the  probability  that  a given  event  will  occur 
following  another  given  event  dependent  on  previous  such 
transition  probabilities. 

Normative : Pertaining  to  preferences,  goals,  norms. 

Normative  Future:  A future  expressed  in  terms  of  goals  and  pref- 

erences rather  than  in  terms  of  predictions  or  probabilities. 

Normex:  A forecasting  method  that  combines  normative  considera- 

tion with  trend  extrapolations. 
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Objective : Determined  by  the  characteristics  of  the  subject 

rather  than  by  preferences  or  emotions;  without  bias  or 
prejudice  insofar  as  possible;  value-free.  Often  contrasted 
with  subjective. 


Operations  Research:  An  early  form  of  systems  analysis  developed 

in  the  military  during  World  War  XI. 


Opinion  Polling1,  A survey  research  technique  in  which  a selected 
group  of  participants  are  asked  their  opinions  on  a specific 
topic. 


Optimization;  Probabilistic  methods  in  which  are  compared  every 
alternative  with  a desired  outcome  in  order  to  secure  the 
most  desired  results  with  the  fewest  undesirable  consequences. 


Panel;  A selected,  organized  group  of  experts. 
Paradigm;  A pattern  or  model. 


Parametric  Sensitivity  Analysis  (PSA);  A probabilistic  forecast- 
ing method  in  which  is  estimated  the  relative  importance  of 
each  input  into  a situation. 


Pattern;  Arrangement  of  form;  disposition  of  parts  or  elements; 
tendency  or  characteristics. 


Pattern  Analysis;  Separation  of  the  pattern  into  its  elements 
to  discover  functions  and  relationships. 


Pattern  Identification;  Forecasting  based  on  the  recognition  of 
a pattern  in  time-series  data  or  trends.  Used  where  data 
are  fuzzy  or  too  complex  for  more  direct  methods. 


Planning;  "Intelligent  cooperation  with  the  inevitable." 


Point  and  Interval  Estimation;  i.  method  of  calculating  the  prob- 
abilities of  various  outcomes  of  a specified  event. 
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Poisson  Distribution;  Refers  to  the  random  distribution  of  ar- 
rivals in  a given  period  of  time  (i.e.,  no  special  pattern). 

Policy  Capture;  The  construction  of  a mathematical  description 
of  an  individual's  priorities  in  order  to  under  his/her 
judgments  (i.e.,  policies)  and  predict  future  judgments. 

Possibility:  Something  that  may  or  may  ndt  happen;  to  be  dis- 

tinguished from  probability. 

Potential  Future;  A description  of  what  can  be  in  a time  to  come; 
to  be  distinguished  from  a forecasted  or  predicted  future. 

Precursor:  A forerunner,  harbinger,  or  leading  indicator. 

Prediction:  A statement  of  what  will  be;  to  be  distinguished 

from  projection,  probability,  and  possibility;  often  used 
synonymously  with  forecast. 

Probabilistic  Forecasting:  The  use  of  mathematical  models  to 

predict  the  future  behavior  of  phenomena  that  behave  in  a 
random  manner. 

Probabilistic  Matrix:  A table  with  values  showing  probability 

distributions. 

Probability!  The  quantified  likelihood  of  something  occurring 
in  a given  way  at  a given  time. 


Problem:  A question  proposed  for  consideration;  an  issue,  diffi- 

culty. 

Problem  Assessment:  Definition  of  the  implications  of  a question 

or  issue. 


Projection:  A statement  of  what  may  be,  based  on  analysis  of 

what  has  been  and  Is j distinguished  from  prediction,  fore- 
cast, and  probability. 

Proxy  Data:  Data  used  in  lieu  of  direct  measurement;  indicators; 

surrogate  data. 

Psychographic : Portrait  of  an  individual  in  terms  of  personality 

traits,  demographics,  behavior  patterns,  and  so  on. 

Qualitative:  Having  to  do  with  essential  characteristics  or  qual- 

ities not  subject  to  quantitative  measurement;  distinguished 
from  quantitative. 

Quality  of  Life:  An  overall  assessment  of  how  pleasant,  rewarding, 

or  "good"  one's  life  is,  and  vice  versa. 

Quantitative : Having  to  do  with  properties  that  can  be  determined 

by  numerical  measurement;  distinguished  from  qualitative. 

Quartile:  Statistical  term  referring  to  one  of  four  groups  of 

equal  frequency  that  make  up  a a distribution. 

Queuing  Theory:  A probabilistic  forecasting  tool  that  provides 

statistical  methods  for  estimating  the  inputs  and  handling 
of  lines  of  customers,  equipment,  or  material. 

Rate  Equation:  The  mathematical  representation  of  change  over 

time  of  a variable. 

Regression  Analysis:  The  numeric  procedure  of  calculating  the 

coefficients  between  two  series  of  variables. 

Relevance : The  degree  of  pertinence;  bearing  upon  the  issue; 

applicability. 

Reliability:  Dependability,  trustworthiness. 

Rigor:  A mathematical  term  meaning  accuracy,  exactitude. 


I*  'l-'Vil-  ’i  r1-' 


u.  liV'  i 1 Mi* ViiiUsi 


Risk:  The  chance  of  damage,  loss,  or  other  unwanted  event;  often 

put  in  probabilistic  terms. 

Risk  Analysis:  A probabilistic  forecasting  method  used  in  deal- 

ing with  one-time-only  operations.  The  Event  Tree  or  the 
Fault  Tree  approaches  are  used  in  this  method. 

Scenario:  An  outline  or  portrait  of  a possible  future;  usually 

portrays  unfolding  events  rather  than  being  static  in  time. 

Sensitivity  Analysis:  A technique  in  which  is  determined  the 

relative  importance  of  different  factors  in  order  to  focus 
on  the  more  crucial  ones. 

Simulation:  A model;  imitating  a system  or  process  in  order  to 

understand  or  predict  its  behavior. 

Social:  Pertaining  to  the  society  or  group. 

Social  Indicators:  Indirect  measures  of  the  well-being,  growth, 

and  so  on  of  the  society;  proxy  data. 

Social  Trends:  Trends  pertaining  to  the  society  as  a system. 

Society,  Societal:  A community  of  interrelated,  interdependent 

individuals  together  comprising  the  social  system. 

Standard  Deviation:  A statistical  measurement  of  variance  from 

the  mean,  given  in  the  original  terms, 

Subjective:  Resulting  from  the  preferences  and  customs  of  the 

individual;  value-laden.  Often  contrasted  with  objective. 

Surprise-Free:  Describing  a future  that  evolves  from  the  present 

without  discontinuities  (l.e.,  surprises);  used  to  describe 
"more-of-the-same"  scenarios. 

Survey  Research:  Research  based  on  asking  people  questions. 

Systems  Analysis:  The  branch  of  science  concerned  with  stating 

problems  in  systematic  forms. 
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Technological:  Having  to  do  with  technical  change  resulting  from 

science,  technology,  and  R&D. 


Theory:  A formulation  of  apparent  relationships  or  underlying 

principles  of  observed  phenomena. 

Time  Horizon : A specific  date  in  the  future. 

Time  Series:  Historical  data  presented  in  uniform  terms  and 

covering  a specified  period  of  time. 

Time  Span:  A specific  period  of  time. 

Trade-Off:  The  give-and-take  involved  in  compromise  or  deal- 

making; the  negatives  that  como  along  with  the  positives. 

Transition  Probability:  The  likelihood  that  a given  event  will 

be  succeeded  by  another  given  event. 

Trend;  A general  tendency  or  course  of  events. 

Trend  Extrapolation;  A forecasting  technique  that  Involves  ex- 
tending time-series  data  in  accordance  with  specified  rules. 

Values ; The  dominant  mores  of  a person  or  society}  the  Bum  of 
an  individual's  preferences,  needs,  beliefs,  priorities, 
motivations,  and  so  on;  in  a society,  those  acts,  customs, 
institutions,  that  are  regarded  in  a particular  way  or  how 
the  group  or  individual  estimates  the  worth  of  these.  In 
mathematics,  the  quantities  represented  by  the  symbols  in 
an  equation. 

Values  Forecasting;  A method  involving  clustering  of  values  into 
a typology  and  forecasting  change  on  the  basis  of  broad  sce- 
narios or  demographic  shifts. 

Values  Studies:  Analysis  and/or  forecasting  the  values  of  indi- 

viduals or  groups. 

Variance:  In  statistics,  the  square  of  the  standard  deviation 

from  the  mean. 
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